3 Commits

Author	SHA1	Message	Date
Marty Schoch	0ddfa774ec	clean up logging to use package level *log.Logger ... by default messages go to ioutil.Discard	2014-12-28 12:14:48 -08:00
Marty Schoch	dcb90ad176	added benchmark for tokenizing English text	2014-10-17 18:07:01 -04:00
Marty Schoch	febb8d2df1	renamed unicode_word_boundary package to icu ... this is in preparation of alternative unicode word boundary impls	2014-10-17 15:15:13 -04:00