diggin/diggin-http-charset

Detecting based on header's charset and html meta charset. Automatically convert to UTF-8.

Maintainers

Details

github.com/diggin/Diggin_Http_Charset

Source

Issues

Installs: 3 056

Dependents: 4

Suggesters: 0

Security: 0

Stars: 6

Watchers: 2

Forks: 5

Open Issues: 0

1.0.0 2019-05-06 04:57 UTC

Requires

  • php: >=5.3.3

Requires (Dev)

LGPL-2.0+ b70193c69087388b6af7c4c0fe5a918f8104c53f

  • sasezaki <sasezaki.woop@gmail.com>

scrapercharsetmbstring

This package is auto-updated.

Last update: 2024-12-06 16:52:50 UTC

README

Automatically convert to UTF-8.

Master: Build Status Coverage Status

Detecting based on header's charset & html meta charset.

(handling several charset more carefully - SJIS-win, TIS-620 and others..)

This library aims to used in web-scraping.

Requirements

  • PHP 5.3 or over
  • mbstring and iconv

Usage

  1. wrap response object:
<?php
use Diggin\Http\Charset\WrapperFactory;
$client = new Zend\Http\Client($url);
$response = $client->send();
$response = WrapperFactory::factory($response); // then, response getBody() return with converted UTF-8.

Please see more at demos/Diggin/Http/Charset .

Guzzle & Goutte

guzzle-plugin-AutoCharsetEncodingPlugin supports for using with Guzzle3.

Usage of with Behat by @MugeSo

Technical Information

Diggin_Http_Charset is based on HTMLScraping.

License

Diggin_Http_Charset is licensed under LGPL(GNU Lesser General Public License).

Similar library

TODOs

  • handling non text/html content types.
  • better APIs & according ZF2 coding standard.
  • struggle in more charset :-\