Marty Schoch
|
ffee3c3764
|
fixed regexp tokenizers to not produce empty tokens
|
2016-09-14 16:22:20 -04:00 |
|
Marty Schoch
|
6b4c86b35a
|
changed whitespace tokenizer to work better on cjk input
now it will return each cjk character as a separate token
this will pair well with a cjk bigram filter for indexing
|
2014-09-07 14:11:01 -04:00 |
|
Marty Schoch
|
7a7eb2e94c
|
add newline between license and package
this avoids cluttering godocs with the license
|
2014-09-02 10:54:50 -04:00 |
|
Marty Schoch
|
1161361bea
|
rename imports from couchbaselabs to blevesearch
|
2014-08-28 15:38:57 -04:00 |
|
Marty Schoch
|
b48dc87afa
|
added test case clarifying whitespace tokenizer on empty input
|
2014-08-19 10:43:52 -04:00 |
|
Marty Schoch
|
25540c736a
|
introduced token type
|
2014-07-31 13:54:12 -04:00 |
|