0
0
Commit Graph

568 Commits

Author SHA1 Message Date
Marty Schoch
e0802a2b39 fixed the worst of the formatting 2015-08-14 16:17:48 -04:00
Marty Schoch
f4df56eb7c add first draft of firestorm proposal 2015-08-14 16:09:19 -04:00
Marty Schoch
d3dda3d0ea fixup config parsing and add new options 2015-08-12 13:18:23 -04:00
Marty Schoch
01667dfff3 faster protobufs with gogo 2015-08-12 13:18:23 -04:00
Marty Schoch
a4b44e25ca Merge pull request #227 from donhcd/customAnalyzerPackage
Move custom_analyzer to custom_analyzer package
2015-08-11 17:36:57 -04:00
Donald Huang
767831d87c move custom_analyzer to custom_analyzer package 2015-08-11 21:22:03 +00:00
Marty Schoch
7df66b4857 fix broken benchmark cause by index row encoding change 2015-08-06 14:48:04 -04:00
Marty Schoch
e255ff52b3 Merge pull request #223 from donhcd/fixTextFieldGoString
Fix invalid fmt string using analysis.Analyzer
2015-08-03 14:04:20 -04:00
Donald Huang
587bed442d fix invalid fmt string using analysis.Analyzer 2015-08-03 17:53:10 +00:00
Marty Schoch
7456842b04 Merge branch 'tukdesk-fix/MaxVarintLen64' 2015-07-31 15:16:34 -04:00
Marty Schoch
9db850a53e Merge branch 'fix/MaxVarintLen64' of https://github.com/tukdesk/bleve into tukdesk-fix/MaxVarintLen64 2015-07-31 15:16:16 -04:00
Marty Schoch
f35e2e42df fix highlighting to work on fields containing arrays
fixes #170
2015-07-31 14:43:12 -04:00
Marty Schoch
3682c25467 update to correctly work with composite fields
also updated search results to return array positions
2015-07-31 11:16:11 -04:00
Marty Schoch
70b23cbe7f Merge branch 'tukdesk-feature/term_vector' 2015-07-29 14:33:15 -04:00
Marty Schoch
c1c4941dde Merge branch 'feature/term_vector' of https://github.com/tukdesk/bleve into tukdesk-feature/term_vector 2015-07-29 14:31:15 -04:00
Marty Schoch
652c188fe8 exclude metrics 2015-07-28 19:10:49 -04:00
Marty Schoch
bf8dcae76b removing build tags 2015-07-28 18:59:10 -04:00
Marty Schoch
1f4ef3da8b move elision filter after lowercase filter
this affects all languages using the elision filter
languages fr and it are updated now
languages ca and ga are still missing other components and
do not yet have an analyzer, but they should follow this lead
once they are ready

fixes #218
2015-07-21 10:43:53 -04:00
Marty Schoch
2a8f319689 added test case for query string containing only MUST NOT clause 2015-07-13 15:30:19 -04:00
Marty Schoch
548b17310b Merge branch 'nimishzynga-test' 2015-07-13 15:26:05 -04:00
Marty Schoch
e8e1556996 Merge branch 'test' of https://github.com/nimishzynga/bleve into nimishzynga-test 2015-07-13 15:23:51 -04:00
Marty Schoch
1b28f6218b additional row validation 2015-07-13 15:22:54 -04:00
Marty Schoch
ad0d580587 add option to bleve_create to select storage 2015-07-13 15:19:56 -04:00
Marty Schoch
17ef48f82a switching back to the canonical goleveldb repo 2015-07-08 12:21:17 -06:00
Nimish Gupta
77779b70f4 Allow query string handling which contains only not must
fixes #193
2015-07-08 16:36:14 +05:30
Marty Schoch
bf80f4628e fix bug in curent goleveldb (must copy during iteration)
also changed over to mschoch fork of goleveldb (temporary)

the change to my fork is pending some read-only issues described
here:  https://github.com/syndtr/goleveldb/issues/111

hopefully we can find a path forward, and get that addressed upstream
2015-07-06 18:00:05 -04:00
Marty Schoch
7f0961424d updated tests for <mark></mark> 2015-07-06 18:00:05 -04:00
Marty Schoch
e2223f5121 changed HTML highlighter to use html mark tag 2015-07-06 18:00:05 -04:00
Marty Schoch
65556f45c7 added additional tests for bug #214 2015-07-06 18:00:05 -04:00
Marty Schoch
7be7ecdf8e fix batch indexing bug, incremented docCount before commit
fixes #211
2015-06-08 14:14:05 -04:00
Marty Schoch
2768c2da3c fix previous sloppy fix which hadn't been adequately tested 2015-05-27 19:15:55 -07:00
Marty Schoch
201fb91171 fix up to correctly trim off separator
even though it should never be present
2015-05-27 19:10:12 -07:00
Marty Schoch
a58592ceff fix case where NewBackIndexRowKV returns nil, nil
the logic for reading the docID from the keys
in this row relies on the keys NEVER containing
the byte separator character (0xff), this is OK
as we require that all keys be valid utf-8
however, it turns out that in the case where this
rule was violated, we would panic, because we
return nil, nil and later try to print the doc id
2015-05-27 19:04:57 -07:00
dtynn
59c97ae577 use binary.MaxVarintLen64 2015-05-26 15:35:31 +08:00
Marty Schoch
2af47cea75 fix query string query syntax when term starts with a number
fixes #207
2015-05-21 15:43:13 -04:00
Marty Schoch
165e63ac09 trying to work around errcheck 2015-05-21 15:20:57 -04:00
Marty Schoch
e0887f9113 fix tests which deadlock boltdb due to deferred cleanup
fixes #209
2015-05-21 12:29:31 -04:00
Marty Schoch
a52d3b5c07 put in hack to allow boltdb reader isolation test to pass
in boltdb, long readers *MAY* block a writer.  in particular if
the write requires additional allocation, it must acquire a lock
already held by the reader.  in general this is not a problem
for bleve (though it can affect performance in some cases), but
it is a problem for the reader isolation test.  this commit
adds a hack to try and avoid the need for additional allocation
closes #208
2015-05-21 11:39:59 -04:00
Marty Schoch
5b8c9f2d73 added unit test for bug #207 2015-05-21 07:49:41 -04:00
Steve Yen
9a09689e61 moved bleve-explorer mapping UI to bleve/http/mapping
All this work comes from Marty Schoch's bleve-explorer UI, but was
moved here for increased reusability.
2015-05-18 11:53:25 -07:00
dtynn
b4f7496031 update the index format version number 2015-05-18 15:16:35 +08:00
dtynn
89dc2c22bc update TermVector 2015-05-17 13:07:14 +08:00
Marty Schoch
8f70def63b properly use the stored array positions when loading a document
fixes #205
2015-05-15 15:47:54 -04:00
Marty Schoch
d11f1336f0 fix issues identified by errcheck 2015-05-15 15:14:15 -04:00
Marty Schoch
328bc73ed0 clarify Batch is not threadsafe in docs
in some limited cases we can detect unsafe usage
in these cases, do not trip over ourselves and panic
instead return a strongly typed error upside_down.UnsafeBatchUseDetected
also, introduced Batch.Reset() to allow batch reuse
this is currently still experimental
closes #195
2015-05-15 15:04:52 -04:00
Marty Schoch
580d9013b2 fix registering tokenizers with dependencies
closes #201
2015-05-14 09:50:10 -04:00
Marty Schoch
7b871fde6a add test comparing search that matches everyting with doc count 2015-05-09 14:51:07 -04:00
Marty Schoch
6f28f3e5bd check error returned in test to make errcheck happy 2015-05-08 08:40:46 -04:00
Marty Schoch
57cd67fa88 fix data race on index metadata (docCount)
closes #198
2015-05-08 08:07:20 -04:00
Marty Schoch
57358088ec fix row merging bug
trying to be clever, we reused the memory allocated for the left
operand when doing partial merges
this had been tested to be safe, in general.  however, the
implementation was then written such that we always reused
globally defined operands, this meant that we mutated
the operands which were intended to always represent
+1/-1
this then cascades quickly to making increment/decrement
values much larger/smaller than they should be
related to #197
2015-05-06 11:00:04 -04:00