Marty Schoch 0ddfa774ec clean up logging to use package level *log.Logger ... by default messages go to ioutil.Discard		2014-12-28 12:14:48 -08:00
..
icu	clean up logging to use package level *log.Logger	2014-12-28 12:14:48 -08:00
regexp_tokenizer	changed whitespace tokenizer to work better on cjk input	2014-09-07 14:11:01 -04:00
single_token	add newline between license and package	2014-09-02 10:54:50 -04:00
unicode	add test to cover kana/ideographic case	2014-11-26 08:42:40 -05:00
whitespace_tokenizer	added benchmark for tokenizing English text	2014-10-17 18:07:01 -04:00