fenom/tokenizer

Stand-alone Fenom's tokenizer

1.0.0 2016-01-19 10:10 UTC

This package is auto-updated.

Last update: 2024-11-29 03:58:18 UTC


README

Tokenize everything by tokenizer:

$tokens = new Tokenizer($everything);