Marty Schoch 8debf26cb7 changed many components to not have defaults ... many of these defaults were arbitrary, and not having defaults lets us more easily flag them for configuration added a shingle filter introduce new toke type for shingles		2014-09-09 18:15:14 -04:00
..
regexp_tokenizer	changed whitespace tokenizer to work better on cjk input	2014-09-07 14:11:01 -04:00
single_token	add newline between license and package	2014-09-02 10:54:50 -04:00
unicode_word_boundary	icu tokenier uses brk status to set token type	2014-09-07 10:24:02 -04:00
whitespace_tokenizer	changed many components to not have defaults	2014-09-09 18:15:14 -04:00