0
0
Commit Graph

896 Commits

Author SHA1 Message Date
Marty Schoch
1c69112820 a few more gofmt simplifications 2016-04-02 22:48:00 -04:00
Marty Schoch
2a703376ea fix ineffectual assignments 2016-04-02 22:42:56 -04:00
Marty Schoch
7892882519 fix typos 2016-04-02 21:59:30 -04:00
Marty Schoch
194ee82c80 gofmt simplifications 2016-04-02 21:54:33 -04:00
Marty Schoch
7594daad01 adding goreportcard 2016-04-02 21:01:23 -04:00
Marty Schoch
0b171c85da change "simple" analyzer to use "letter" tokenizer
this change improves compatibility with the simple analyzer
defined by Lucene.  this has important implications for
some perf tests as well as they often use the simple
analyzer.
2016-03-31 15:13:17 -04:00
Marty Schoch
d774f980d3 search request JSON omitting size, now defaults to 10
this change only affects JSON parsing, any search request which
omits the size field entirely now defaults to 10 which
is the same behavior as NewSearchRequest()

0 is still a valid size, but must be set explicitly
2016-03-31 09:56:06 -04:00
Marty Schoch
2b82387eae export the Validate method on mapping objects 2016-03-28 17:14:41 -04:00
Marty Schoch
639fb1ab89 remove NativeMergeOperator from core, it requires unsafe 2016-03-24 12:06:43 -04:00
Marty Schoch
1f0509fe48 Merge pull request #365 from bcampbell/documenting
some minor godoc additions
2016-03-22 18:10:40 -04:00
Ben Campbell
4fafb2be3f Merge branch 'master' into documenting 2016-03-23 10:48:09 +13:00
Marty Schoch
724684a4f1 additional firestorm fixes for 64-bit alignment
part of #359
2016-03-20 11:02:13 -04:00
Marty Schoch
3dc64de478 moved fields requiring 64-bit alignment to start of struct
several data structures had a pointer at the start of the struct
on some 32-bit systems, this causes the remaining fields no longer
be aligned on 64-bit boundaries

the fix identifed by @pmezard is to put the counters first in the
struct, which guarantees correct alignment

fixes #359
2016-03-20 10:38:28 -04:00
Marty Schoch
5ea6b063ad Merge pull request #358 from steveyen/master
MB-18715 - moss Merge fix
2016-03-15 20:26:24 -04:00
Steve Yen
be2800a8e4 MB-18715 - moss Merge() didn't bump bufUsed correctly
And, also allocate more memory for both the partial and full merges.
2016-03-15 17:09:40 -07:00
Marty Schoch
f1abf6beb3 facets now also have secondary sort
in case of term facets, secondary sort (after count) is on the term
for date and numberic facets, secondary sort is on the facet name

fixes #335
2016-03-14 12:02:30 -04:00
Marty Schoch
1817f28cfc rewrote to use same appraoch as numeric facets
see https://github.com/blevesearch/bleve/pull/134
2016-03-14 12:02:07 -04:00
Marty Schoch
0a343acb0d Merge pull request #355 from MachineShop-IOT/master
Minor fix to ensure full index path exists
2016-03-14 09:49:19 -04:00
Mark Mindenhall
c5b8544708 Minor fix to ensure full index path exists 2016-03-13 21:44:21 -06:00
Marty Schoch
cecdfcbc69 moving japanese analyzer to blevex package 2016-03-13 18:05:05 -04:00
Marty Schoch
0de657d3ca Merge pull request #343 from ikawaha/fix/ja_morph_kagome
Use a small version of kagome
2016-03-13 17:53:27 -04:00
Marty Schoch
b31f15002b Merge pull request #354 from steveyen/master
moss lowerLevelUpdate didn't handle batches of size 1
2016-03-13 11:43:46 -04:00
Steve Yen
c1597842d0 moss lowerLevelUpdate didn't handle batches of size 1 2016-03-11 15:47:23 -08:00
Marty Schoch
e76b1dd8f3 better logging on index mapping corruption 2016-03-11 16:36:43 -05:00
Marty Schoch
22a54caf45 fix handling of dynamic property in mappings of sub-documents
fixes #353
2016-03-11 12:18:24 -05:00
Marty Schoch
3627c92f08 more defensive merging of errors in search result status
necessary when combining after json serialization since the
combinatin of omitempty tag means empty map becomes nil map
2016-03-10 16:04:05 -05:00
Marty Schoch
f190473c5e Merge pull request #352 from steveyen/moss-RegistryCollectionOptions
moss CollectionOptions registry
2016-03-09 14:24:05 -05:00
Steve Yen
f1dac8b497 moss defaults to non-nil options.Log 2016-03-09 10:15:11 -08:00
Steve Yen
1d63c55f7c parse mossLowerLevelMaxBatchSize only when lower-level-store exists 2016-03-09 10:09:15 -08:00
Steve Yen
76b9365928 added moss RegistryCollectionOptions
The moss RegistryCollectionOptions allows applications to register
moss-related callback API functions and other advanced feature usage
at process initialization time.

For example, this could be used for moss's OnError(), OnEvent() and
logging callback options.
2016-03-09 09:40:29 -08:00
Marty Schoch
57919a77f5 add support for toggling Store/Index Dynamic in IndexMapping 2016-03-08 07:58:29 -05:00
Marty Schoch
d7292ed891 add support for gathering stats via map for easier consumption 2016-03-07 18:37:46 -05:00
Marty Schoch
e00577f265 change registry cache implementation to allow concurrent use
previously we just used a Go builtin map
this was not safe for concurrent read/write and upon upgrading
to Go 1.6 we were notified of the problem

fixes #349
2016-03-07 16:05:34 -05:00
Marty Schoch
e51f4d5450 changing async test strategy, was failing in go 1.6 2016-03-07 09:39:20 -05:00
Marty Schoch
5badbfdb0e allow running integration tests on alternate kvstore 2016-03-07 08:40:15 -05:00
Marty Schoch
23a323bc9d add support for numPlainTextBytesIndexed metric 2016-03-05 14:05:08 -05:00
Marty Schoch
81780f97d0 add term search stats 2016-03-05 07:50:25 -05:00
Marty Schoch
147debaa12 expose metrics and moss stats wrapping underlying stats as well 2016-03-04 13:43:39 -05:00
Marty Schoch
9d2f424a88 Merge pull request #348 from steveyen/moss-MaxPreMergerBatches-renamed
moss option MaxPreMergerBatches renamed
2016-03-03 15:03:49 -05:00
Steve Yen
f6d1bd2c87 moss option MaxPreMergerBatches renamed 2016-03-03 11:18:30 -08:00
Marty Schoch
b057dacfe4 Merge pull request #347 from mschoch/context
introduce ability for searches to timeout or be cancelled
2016-03-02 18:04:54 -05:00
Marty Schoch
0b2380d9bf introduce ability for searches to timeout or be cancelled
our implementation uses: golang.org/x/net/context

New method SearchInContext() allows the user to run a search
in the provided context.  If that context is cancelled or
exceeds its deadline Bleve will attempt to stop and return
as soon as possible.  This is a *best effort* attempt at this
time and may *not* be in a timely manner.  If the caller must
return very near the timeout, the call should also be wrapped
in a goroutine.

The IndexAlias implementation is affected in a slightly more
complex way.  In order to return partial results when a timeout
occurs on some indexes, the timeout is strictly enforced, and
at the moment this does introduce an additional goroutine.

The Bleve implementation honoring the context is currently
very course-grained.  Specifically we check the Done() channel
between each DocumentMatch produced during the search.  In the
future we will propogate the context deeper into the internals
of Bleve, and this will allow finer-grained timeout behavior.
2016-03-02 17:30:21 -05:00
Marty Schoch
f1a3a7a221 Merge pull request #346 from steveyen/MB-18441
MB-18441 - moss lower-level iterator starts  positioned on current
2016-03-02 08:40:07 -05:00
Steve Yen
7d67d89a9c MB-18441 - moss lower-level iterator starts positioned on current
The iterator starts off positioned so that Current() is correct, so
invoking Next() right off the bat was incorrect.
2016-03-01 21:45:48 -08:00
Marty Schoch
758cb54952 Merge pull request #345 from korzonek/master
codebeat badge
2016-03-01 08:13:26 -05:00
Tomasz Korzeniowski
a866c0cbf9 codebeat badge
Is it fine to add codebeat badge to README? 

codebeat is automated code review tool for Swift, Ruby & Go that helps get instant feedback on code quality. 

"Quick wins" suggested by codebeat could be a nice candidate for a pull request and help other developers become contributors.

FYI. To be fully open and honest. I'm co-founder of codebeat.
2016-03-01 13:51:12 +01:00
Marty Schoch
2527651c6d fix broken identification of analyzer for field name 2016-02-26 17:33:39 -05:00
Marty Schoch
265ab24b6e Merge pull request #339 from steveyen/WIP-moss
integrate index/store/moss KV store
2016-02-26 09:36:49 -05:00
Marty Schoch
a5bb81e19b fix highlighting bug with array values 2016-02-24 14:06:47 -05:00
Marty Schoch
6c988de5b5 fix date facet merging for searches on index aliases
previously we incorrectly identified matching buckets by
comparing string pointers.  this worked in the unit test
but not in real applications since the strings result from
date parsing inside the facet collector, and are therefore
different pointers
2016-02-23 15:33:07 -05:00