2 Commits

Author	SHA1	Message	Date
Marty Schoch	043a3bfb7c	change cjk analyzer to use unicode tokenizer ... change cjk bigram analyzer to work with multi-rune terms add cjk width filter replaces full unicode normailzation these changes make the cjk analyzer behave more like elasticsearch they also remove the depenency on the whitespace analyzer which is now free to also behave more like lucene/es fixes #33	2016-06-10 13:04:40 -04:00
Marty Schoch	1a1cf32a86	introducing cjk_bigram filter and cjk analyzer ... closes #34	2014-09-11 10:39:05 -04:00