diggin/diggin-scraper

web-sraping component, inspired by Perl’s Web::Scraper. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged PHP ‘s multidimensional array

Maintainers

Details

github.com/diggin/Diggin_Scraper

Source

Issues

Installs: 79

Dependents: 1

Suggesters: 0

Security: 0

Stars: 8

Watchers: 4

Forks: 2

Open Issues: 0

v0.9.2 2015-12-24 16:17 UTC

Requires

Requires (Dev)

BSD-3-Clause 481482f5a37867de471e044a60905fc5bf0a1d2c

  • sasezaki <sasezaki.woop@gmail.com>

This package is auto-updated.

Last update: 2024-12-06 16:47:01 UTC

README

web-sraping component, inspired by Perl’s Web::Scraper. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged PHP's multidimensional array.

#CHANGELOG for 0.9.0 change behavior when extracting target is not found #1

if you want throw exception for v0.8 compatibility, please use throwTargetExceptionsOn method.

$scraper->throwTargetExceptionsOn(true);

Feature

  • into multidimensional array
  • Handle CSS Selector or XPath expression
  • Automatically convert to UTF-8
  • based on Diggin_Http_Charset
  • Beautify ugly HTML into XHTML automatically
  • based on Diggin_Scraper_Adapter_Htmlscraping & tidy
  • convert relative path into absolute URL automatically ("a href" & "img src")
  • Enable change Strategy (xpath or regex) & Enable change pretreat converting HTML

Requirements

  • PHP 5.3.3 or over
  • Zend Framework 2
  • Diggin components
  • Diggin_Http_Charset
  • Diggin_Scraper_Adapter_Htmlscraping