7a7eb2e94c
this avoids cluttering godocs with the license |
||
---|---|---|
.. | ||
regexp_tokenizer | ||
single_token | ||
unicode_word_boundary | ||
whitespace_tokenizer |
7a7eb2e94c
this avoids cluttering godocs with the license |
||
---|---|---|
.. | ||
regexp_tokenizer | ||
single_token | ||
unicode_word_boundary | ||
whitespace_tokenizer |