Marty Schoch f81b2be334 major refactor of bleve configuration ... see #221 for full details		2015-09-16 17:10:59 -04:00
..
exception	new tokenizer that allows you to pre-identify tokens with regexp	2015-04-08 15:31:58 -04:00
regexp_tokenizer	changed whitespace tokenizer to work better on cjk input	2014-09-07 14:11:01 -04:00
single_token	add newline between license and package	2014-09-02 10:54:50 -04:00
unicode	change unicode tokenizer to use direct segmenter api	2015-01-12 17:57:45 -05:00
whitespace_tokenizer	added benchmark for tokenizing English text	2014-10-17 18:07:01 -04:00