0
0
Commit Graph

449 Commits

Author SHA1 Message Date
Marty Schoch
af356acff0 changed batch behavior
now created through the index itself
mapping problems reported early at the time
data is added to the batch, previously these
were not reported until the batch was executed
2015-03-09 08:20:39 -04:00
Marty Schoch
eaccd74c93 Merge pull request #134 from Shugyousha/numfacet
Add a benchmark for the numeric facet builder and use sort.Sort in it (just like for the terms one)
2015-03-06 14:50:30 -05:00
Marty Schoch
300ec79c96 first pass at checking errors that were ignored
part of #169
2015-03-06 14:46:29 -05:00
Marty Schoch
a2ad7634f2 update term freq rows to use varint where possible
benchmark old ns/op new ns/op delta
BenchmarkLevelDBIndexing1Workers 1138292 657901 -42.20%
BenchmarkLevelDBIndexing2Workers 1619323 647628 -60.01%
BenchmarkLevelDBIndexing4Workers 1172845 636478 -45.73%
BenchmarkLevelDBIndexing1Workers10Batch 465556545 448153394 -3.74%
BenchmarkLevelDBIndexing2Workers10Batch 504203911 449657355 -10.82%
BenchmarkLevelDBIndexing4Workers10Batch 510766435 439839335 -13.89%
BenchmarkLevelDBIndexing1Workers100Batch 307657846 268976464 -12.57%
BenchmarkLevelDBIndexing2Workers100Batch 302257400 269110215 -10.97%
BenchmarkLevelDBIndexing4Workers100Batch 305320485 259084902 -15.14%
BenchmarkLevelDBIndexing1Workers1000Batch 301320576 258070231 -14.35%
BenchmarkLevelDBIndexing2Workers1000Batch 334174454 261175641 -21.84%
BenchmarkLevelDBIndexing4Workers1000Batch 267732436 261461739 -2.34%

closes #165
2015-03-06 13:00:53 -05:00
Marty Schoch
ee1210bc82 updated bleve_query to allow benchmarking single queries 2015-03-06 13:00:11 -05:00
Marty Schoch
7284c10020 added benchmark to collector 2015-03-06 12:59:44 -05:00
Marty Schoch
5ac9583370 fix godoc around NewFuzzyQuery function
closes #166
2015-03-02 09:29:06 -05:00
Marty Schoch
221664977d Merge pull request #167 from gitter-badger/gitter-badge
Add a Gitter chat badge to README.md
2015-03-02 09:23:51 -05:00
The Gitter Badger
1b91caa536 Added Gitter badge 2015-02-23 19:54:11 +00:00
Marty Schoch
0771f813ce SearchResult Took field now returns full time in Search()
likewise, MultiSearch used by aliases spanning multiple
will also return full time in MultiSearch()
closes #163
2015-02-19 12:11:40 +05:30
Marty Schoch
daeaa2c129 fix bad math in multi search, and return original reqest in res
related to #164
2015-02-18 17:24:22 +05:30
Marty Schoch
c566d34264 bump index format version number, start checking version on open 2015-02-17 17:16:31 +05:30
Marty Schoch
251e4717a2 Merge pull request #161 from nimishzynga/master
Minor change in example code in README
2015-02-17 11:47:55 +05:30
Nimish Gupta
1ce81c2f85 Minor change in example code in README 2015-02-17 11:40:07 +05:30
Marty Schoch
afbda14dc2 fix mapping analyzer lookup with multiple fields
closes #159
2015-02-13 08:46:36 -05:00
Marty Schoch
2f607d73f3 Merge pull request #157 from saljam/arabic
Further improvements to the Arabic analyzer
2015-02-11 15:49:19 -05:00
Marty Schoch
fb0db7066f improve highlighting with multi-byte characters
fixes #156
2015-02-06 12:35:01 -05:00
Salmān Aljammāz
9444af9366 arabic: add unicode normalization to analyzer 2015-02-06 19:50:58 +03:00
Salmān Aljammāz
91a8d5da9f arabic: check minimum length before stemming
This invloves converting tokens to a rune slice in the filter, but
at least we're now compatable with Lucene's stemmer.
2015-02-06 19:50:58 +03:00
Salmān Aljammāz
0470f93955 arabic: add more stemmer tests
These came from org.apache.lucene.analysis.ar.
2015-02-06 19:49:30 +03:00
Marty Schoch
15139b8fa5 fix panic on mapping value containing null
added testcase to reproduce initial issue
closes #153
2015-02-05 16:15:05 -05:00
Marty Schoch
41cd64337b Merge pull request #155 from saljam/ar_stemmer
arabic stemmer: strip multiple suffixes
2015-02-05 08:13:15 -05:00
Salmān Aljammāz
e461fed92a arabic stemmer: strip multiple suffixes
updates #150
2015-02-05 16:07:58 +03:00
Marty Schoch
4be974f489 added first implementation of arabic analyzer
one test cases is not passing and is commented out temporarily
updates #150
2015-02-05 07:44:55 -05:00
Marty Schoch
b9c22fe50d Merge pull request #154 from saljam/arabic
add arabic light stemmer
2015-02-05 07:09:54 -05:00
Salmān Aljammāz
945ef8158f add arabic light stemmer
fixes #28
updates #150
2015-02-05 13:24:30 +03:00
Marty Schoch
dd1cd189a7 added initial implementation of hindi analyzer
closes #66
2015-02-04 15:12:08 -05:00
Steve Yen
38ee9be353 added some batch size 1000 microbenchmarks 2015-01-30 15:58:39 -08:00
Steve Yen
7d6a6aeaa8 single append for inmem KVStore batch 2015-01-29 11:14:08 -08:00
Steve Yen
5a30d36b17 cznicb KVStore uses Put() for faster read-modify-write 2015-01-29 11:02:01 -08:00
Steve Yen
b054cddf76 gtreap KVStore does 1 append for batch Set/Delete 2015-01-29 10:49:39 -08:00
Steve Yen
05d222f490 cznicb KVStore batch uses <2 appends per Set/Delete 2015-01-29 10:22:13 -08:00
Steve Yen
c5c59e61f4 make leveldb faster with non-zero sized batch 2015-01-29 10:20:26 -08:00
Steve Yen
1c1774d4ad throw away data even faster in null KVStore 2015-01-29 10:17:21 -08:00
Marty Schoch
a9f153bac7 fix typo in unicode normalization form constant
also adjusted incorrect tests
fixes #149
2015-01-26 14:09:20 -05:00
Marty Schoch
ce44378b9c only add highlighted fragments to map if successfully built some 2015-01-22 17:45:13 -05:00
Marty Schoch
a69fa1e91d adding tests based on problems found with fosdem dataset 2015-01-22 09:57:26 -05:00
Marty Schoch
0ed47f5343 fix advance logic to not skip over result 2015-01-22 09:56:40 -05:00
Marty Schoch
5a09ceeac8 fix traversal logic when not in expected order 2015-01-22 09:56:21 -05:00
Marty Schoch
e59ed148c9 avoid crash when requesting more facets then available 2015-01-22 09:56:00 -05:00
Marty Schoch
944fae27f0 parse size and field for facets, print facet results 2015-01-22 09:55:20 -05:00
Marty Schoch
8891a3688d mapping should consult default mapping for analyzers 2015-01-22 09:54:32 -05:00
Marty Schoch
29b4f9623a fix query parser to recognize field prefix before fuzzy tilde 2015-01-19 16:20:32 -05:00
Marty Schoch
521d6101fd fix issue identified by go vet 2015-01-19 15:50:07 -05:00
Marty Schoch
7e3ba85b9d added test and fixed behavior to ensure correct value is stored
optimization introduced last week inadvertently meant we were
not preserving the original byte values of text fields that
were stored
2015-01-19 15:40:18 -05:00
Marty Schoch
3ea1894dea fix rendering of non-text fields 2015-01-19 15:39:43 -05:00
Marty Schoch
3e4969efbc change defaul fuzziness to 2 as that is more common 2015-01-19 14:08:22 -05:00
Marty Schoch
3e72949563 Merge branch 'StreamBoat-fix_ptr_handling' 2015-01-16 17:49:37 -05:00
Marty Schoch
50090dd199 added test for mapping struct with pointer to string 2015-01-16 17:49:01 -05:00
Marty Schoch
141585b806 Merge branch 'fix_ptr_handling' of https://github.com/StreamBoat/bleve into StreamBoat-fix_ptr_handling 2015-01-16 17:48:25 -05:00