gibheer/bleve
0
0
Fork 0
Code
483 Commits 10 Branches 0 Tags 12 MiB
93e01a803e
Commit Graph

483 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marty Schoch
93e01a803e fix issues identified by errcheck 
part of #169
 2015-04-07 14:52:00 -04:00
Marty Schoch
f1ec73e764 fix issues identified by errcheck 
part of #169
 2015-04-07 13:26:54 -04:00
Marty Schoch
56a30a3574 fix issues identified by errcheck 
part of #169
 2015-04-07 13:05:47 -04:00
Marty Schoch
d2e9409413 fix issues identified by errcheck 
part of #169
 2015-04-07 12:04:59 -04:00
Marty Schoch
24729541b5 fix issues identified by errcheck 
also add bulkindex utility to gitignore
part of #169
 2015-04-07 11:42:46 -04:00
Marty Schoch
35a4333bce fix issues identified by errcheck 
part of #169
 2015-04-07 11:39:01 -04:00
Marty Schoch
de2e3f4d72 fix improper call to fmt.Errorf instead of Printf 2015-04-07 11:24:01 -04:00
Marty Schoch
dd921d31e3 undoing f92ab131e4 
we now guarantee bytes were copied earlier in the chain
the kv store is NOT responsible for making an additional copy
closes #181
 2015-04-07 11:12:28 -04:00
Marty Schoch
443c0252e0 fix another metrics BytesSafeAfterClose() loop 
closes #184
 2015-04-03 21:17:23 -04:00
Steve Yen
efc39a6857 fix metrics BytesSafeAfterClose() loop 
fixes issue 184
 2015-04-03 16:36:32 -07:00
Marty Schoch
11262c793f fix bug, internal ops must check that index is open 
possibly fixes https://github.com/couchbaselabs/cbft/issues/49
 2015-04-03 18:05:24 -04:00
Marty Schoch
867110e03b major improvements to index row encoding 
improvements uncovered some issues with how k/v data was copied
or not.  to address this, kv abstraction layer now lets impl
specify if the bytes returned are safe to use after a reader
(or writer since writers are also readers) are closed
See index/store/KVReader - BytesSafeAfterClose() bool
false is the safe value if you're not sure
it will cause index impls to copy the data
Some kv impls already have created a copy a the C-api barrier
in which case they can safely return true.

Overall this yields ~25% speedup for searches with leveldb.
It yields ~10% speedup for boltdb.
Returning stored fields is now slower with boltdb, as previously
we were returning unsafe bytes.
 2015-04-03 16:50:48 -04:00
Marty Schoch
52712b9537 add missing index close causing tests to sometimes fail 2015-04-03 16:41:11 -04:00
Steve Yen
dbf50b7f29 KVStore gtreap allows only 1 writer at a time 2015-03-26 16:40:18 -07:00
Steve Yen
f92ab131e4 KVStore gtreap implementation copies value bytes 2015-03-26 14:46:37 -07:00
Steve Yen
78453dab7d metrics KVStore now tracks last 100 errors 2015-03-19 18:41:16 -07:00
Marty Schoch
62645f10a2 Merge pull request #179 from gsathya/add_index_tests 
Add tests for Index
 2015-03-19 16:56:45 -04:00
Sathyanarayanan Gunasekaran
5c7aa21643 Add test for index.Stats 2015-03-19 14:06:59 -04:00
Sathyanarayanan Gunasekaran
d9a7a2e3a0 Add test for index.FieldDictPrefix 2015-03-19 14:06:59 -04:00
Sathyanarayanan Gunasekaran
5b4ee3e598 Add test for index.FieldDictRange 2015-03-19 14:06:59 -04:00
Marty Schoch
6f185f8cc0 fix highlighting bug when terms overlap (ngram analysis) 
fixes #178
 2015-03-18 14:34:47 -04:00
Marty Schoch
a41f229b14 added regexp and wildcard queries 
fixes #152
 2015-03-11 16:57:22 -04:00
Marty Schoch
183fcd4b14 added a missing check for errors 2015-03-11 16:56:01 -04:00
Marty Schoch
a44a7c01af rewrite to used fixed size []byte instead of buffer 
removes unchecked errors in calls to buffer.Write
and also benchmarks considerably faster
 2015-03-11 15:12:13 -04:00
Marty Schoch
50bd082257 fixed issues with portuguese analyzer 
fixes #70
 2015-03-11 14:22:11 -04:00
Marty Schoch
7970f42c29 fix issues with italian analyzer 
switch it to not require icu/libstemmer
fixes #69
 2015-03-11 11:48:13 -04:00
Marty Schoch
eeaf514848 switch fr to not require icu/libstemmer 
also corrected copy/paste bug in test
 2015-03-11 11:46:33 -04:00
Marty Schoch
8ae30fb6f0 fix issues with lucene stemmer 
fixes issue #68
 2015-03-11 11:14:29 -04:00
Marty Schoch
b5a79c8ecc Merge pull request #173 from gsathya/fix_return_err 
Check all return errors
 2015-03-11 08:30:42 -04:00
Sathyanarayanan Gunasekaran
93e749bc0c Check all return errors 
- Fix the following errors found by errcheck :
  $ bleve git:(master) errcheck github.com/blevesearch/bleve
  github.com/blevesearch/bleve/index_impl.go:206:25  defer indexReader.Close()
  github.com/blevesearch/bleve/index_impl.go:317:25  defer indexReader.Close()
  github.com/blevesearch/bleve/index_impl.go:353:25  defer indexReader.Close()
  github.com/blevesearch/bleve/index_impl.go:359:22  defer searcher.Close()
  github.com/blevesearch/bleve/index_impl.go:497:25  defer indexReader.Close()
  github.com/blevesearch/bleve/index_impl.go:644:20  defer reader.Close()
  github.com/blevesearch/bleve/index_meta.go:67:27   defer indexMetaFile.Close()
 2015-03-11 01:28:51 -04:00
Marty Schoch
522f9d5cc7 significant change to index format, support dictionary rows 
this introduces disk format v4
now the summary rows for a term are stored in their own
"dictionary row" format, previously the same information
was stored in special term frequency rows
this now allows us to easily iterate all the terms for a field
in sorted order (useful for many other fuzzy data structures)

at the top-level of bleve you can now browse terms within a field
using the following api on the Index interface:

  FieldDict(field string) (index.FieldDict, error)
  FieldDictRange(field string, startTerm []byte, endTerm []byte) (index.FieldDict, error)
  FieldDictPrefix(field string, termPrefix []byte) (index.FieldDict, error)

fixes #127
 2015-03-10 16:22:19 -04:00
Marty Schoch
4e14f4e4ef change path for forestdb test to correctly cleanup 
this is due to forestdb auto-compaction using the provided
path as just the prefix, so if we're not careful we end
up with many stray files laying around
here, we create a sub-directory first, and just nuke the
whole subdir when we're done
 2015-03-10 14:05:58 -04:00
Marty Schoch
0df0a6fcb2 better logging on which test failed in integration tests 2015-03-10 14:05:30 -04:00
Marty Schoch
18dabdb946 fix compilation of bulk index utility 2015-03-09 08:20:40 -04:00
Marty Schoch
af356acff0 changed batch behavior 
now created through the index itself
mapping problems reported early at the time
data is added to the batch, previously these
were not reported until the batch was executed
 2015-03-09 08:20:39 -04:00
Marty Schoch
eaccd74c93 Merge pull request #134 from Shugyousha/numfacet 
Add a benchmark for the numeric facet builder and use sort.Sort in it (just like for the terms one)
 2015-03-06 14:50:30 -05:00
Marty Schoch
300ec79c96 first pass at checking errors that were ignored 
part of #169
 2015-03-06 14:46:29 -05:00
Marty Schoch
a2ad7634f2 update term freq rows to use varint where possible 
benchmark old ns/op new ns/op delta
BenchmarkLevelDBIndexing1Workers 1138292 657901 -42.20%
BenchmarkLevelDBIndexing2Workers 1619323 647628 -60.01%
BenchmarkLevelDBIndexing4Workers 1172845 636478 -45.73%
BenchmarkLevelDBIndexing1Workers10Batch 465556545 448153394 -3.74%
BenchmarkLevelDBIndexing2Workers10Batch 504203911 449657355 -10.82%
BenchmarkLevelDBIndexing4Workers10Batch 510766435 439839335 -13.89%
BenchmarkLevelDBIndexing1Workers100Batch 307657846 268976464 -12.57%
BenchmarkLevelDBIndexing2Workers100Batch 302257400 269110215 -10.97%
BenchmarkLevelDBIndexing4Workers100Batch 305320485 259084902 -15.14%
BenchmarkLevelDBIndexing1Workers1000Batch 301320576 258070231 -14.35%
BenchmarkLevelDBIndexing2Workers1000Batch 334174454 261175641 -21.84%
BenchmarkLevelDBIndexing4Workers1000Batch 267732436 261461739 -2.34%

closes #165
 2015-03-06 13:00:53 -05:00
Marty Schoch
ee1210bc82 updated bleve_query to allow benchmarking single queries 2015-03-06 13:00:11 -05:00
Marty Schoch
7284c10020 added benchmark to collector 2015-03-06 12:59:44 -05:00
Marty Schoch
5ac9583370 fix godoc around NewFuzzyQuery function 
closes #166
 2015-03-02 09:29:06 -05:00
Marty Schoch
221664977d Merge pull request #167 from gitter-badger/gitter-badge 
Add a Gitter chat badge to README.md
 2015-03-02 09:23:51 -05:00
The Gitter Badger
1b91caa536 Added Gitter badge 2015-02-23 19:54:11 +00:00
Marty Schoch
0771f813ce SearchResult Took field now returns full time in Search() 
likewise, MultiSearch used by aliases spanning multiple
will also return full time in MultiSearch()
closes #163
 2015-02-19 12:11:40 +05:30
Marty Schoch
daeaa2c129 fix bad math in multi search, and return original reqest in res 
related to #164
 2015-02-18 17:24:22 +05:30
Marty Schoch
c566d34264 bump index format version number, start checking version on open 2015-02-17 17:16:31 +05:30
Marty Schoch
251e4717a2 Merge pull request #161 from nimishzynga/master 
Minor change in example code in README
 2015-02-17 11:47:55 +05:30
Nimish Gupta
1ce81c2f85 Minor change in example code in README 2015-02-17 11:40:07 +05:30
Marty Schoch
afbda14dc2 fix mapping analyzer lookup with multiple fields 
closes #159
 2015-02-13 08:46:36 -05:00
Marty Schoch
2f607d73f3 Merge pull request #157 from saljam/arabic 
Further improvements to the Arabic analyzer
 2015-02-11 15:49:19 -05:00