0
0
Commit Graph

1116 Commits

Author SHA1 Message Date
Marty Schoch
d0c6dbc9cf unregister index from expvar stats on close 2016-04-20 11:43:14 -04:00
Marty Schoch
709b418823 properly initialize index stats object for in memory indexes 2016-04-20 11:37:51 -04:00
Marty Schoch
53f7eb2891 multi-term searches check DisjunctionMaxClauseCount earlier
regexp, fuzzy and numeric range searchers now check to see if
they will be exceeding a configured DisjunctionMaxClauseCount
and stop work earlier, this does a better job of avoiding
situations which consume all available memory for an operation
they cannot complete
2016-04-18 10:06:34 -04:00
Marty Schoch
c7ae842b33 fix marshaling of MatchNone queries 2016-04-16 20:51:27 -04:00
Marty Schoch
95b03f9b54 Merge pull request #370 from mschoch/safermetrics
do not put +/-Inf or NaN values into the stats map
2016-04-15 13:56:25 -04:00
Marty Schoch
73b514fa4f do not put +/-Inf or NaN values into the stats map 2016-04-15 13:39:30 -04:00
Marty Schoch
18b50305e4 update travis to build with deps specified in manifest 2016-04-08 17:06:25 -04:00
Marty Schoch
d06f4b3860 fix manifest versions
i was too eager to commit the manifest and do the release
the original manifest contained "too new" versions for some
of the deps
2016-04-08 16:49:18 -04:00
Marty Schoch
7ec37d6533 add support for wildcard and regexp queries to query string
you can now use terms like:

test?string*

and similar text in query strings to perform wildcard
searches.  also if you use:

/aregexp/

it will perform a regexp search as well
2016-04-08 15:56:02 -04:00
Marty Schoch
2f59b75ce4 Merge branch 'mschoch-fix-data-race' 2016-04-08 15:32:47 -04:00
Marty Schoch
b8a2fbb887 fix data race in bleve batch reuse
Currently bleve batch is build by user goroutine
Then read by bleve gourinte
This is still safe when used correctly
However, Reset() will modify the map, which is now a data race

This fix is to simply make batch.Reset() alloc new maps.
This provides a data-access pattern that can be used safely.
Also, this thread argues that creating a new map may be faster
than trying to reuse an existing one:

https://groups.google.com/d/msg/golang-nuts/UvUm3LA1u8g/jGv_FobNpN0J

Separate but related, I have opted to remove the "unsafe batch"
checking that we did.  This was always limited anyway, and now
users of Go 1.6 are just as likely to get a panic from the
runtime for concurrent map access anyway.  So, the price paid
by us (additional mutex) is not worth it.

fixes #360 and #260
2016-04-08 15:32:13 -04:00
Marty Schoch
617fcf693e add initial manifest 2016-04-08 15:03:05 -04:00
Marty Schoch
74b7872987 fix marshaling of MatchAll queries 2016-04-07 18:20:35 -04:00
Marty Schoch
36170a4736 more gofmt simplifications 2016-04-03 00:03:33 -04:00
Marty Schoch
dd209dcbf2 tweak syntax to make older go vet happy 2016-04-02 23:54:36 -04:00
Marty Schoch
4433964f78 tweak syntax 2016-04-02 23:17:47 -04:00
Marty Schoch
020ea1b8ee tweak syntax slightly 2016-04-02 23:08:43 -04:00
Marty Schoch
1c69112820 a few more gofmt simplifications 2016-04-02 22:48:00 -04:00
Marty Schoch
2a703376ea fix ineffectual assignments 2016-04-02 22:42:56 -04:00
Marty Schoch
7892882519 fix typos 2016-04-02 21:59:30 -04:00
Marty Schoch
194ee82c80 gofmt simplifications 2016-04-02 21:54:33 -04:00
Marty Schoch
7594daad01 adding goreportcard 2016-04-02 21:01:23 -04:00
Marty Schoch
0b171c85da change "simple" analyzer to use "letter" tokenizer
this change improves compatibility with the simple analyzer
defined by Lucene.  this has important implications for
some perf tests as well as they often use the simple
analyzer.
2016-03-31 15:13:17 -04:00
Marty Schoch
d774f980d3 search request JSON omitting size, now defaults to 10
this change only affects JSON parsing, any search request which
omits the size field entirely now defaults to 10 which
is the same behavior as NewSearchRequest()

0 is still a valid size, but must be set explicitly
2016-03-31 09:56:06 -04:00
Marty Schoch
2b82387eae export the Validate method on mapping objects 2016-03-28 17:14:41 -04:00
Marty Schoch
639fb1ab89 remove NativeMergeOperator from core, it requires unsafe 2016-03-24 12:06:43 -04:00
Marty Schoch
1f0509fe48 Merge pull request #365 from bcampbell/documenting
some minor godoc additions
2016-03-22 18:10:40 -04:00
Ben Campbell
4fafb2be3f Merge branch 'master' into documenting 2016-03-23 10:48:09 +13:00
Marty Schoch
724684a4f1 additional firestorm fixes for 64-bit alignment
part of #359
2016-03-20 11:02:13 -04:00
Marty Schoch
3dc64de478 moved fields requiring 64-bit alignment to start of struct
several data structures had a pointer at the start of the struct
on some 32-bit systems, this causes the remaining fields no longer
be aligned on 64-bit boundaries

the fix identifed by @pmezard is to put the counters first in the
struct, which guarantees correct alignment

fixes #359
2016-03-20 10:38:28 -04:00
Marty Schoch
5ea6b063ad Merge pull request #358 from steveyen/master
MB-18715 - moss Merge fix
2016-03-15 20:26:24 -04:00
Steve Yen
be2800a8e4 MB-18715 - moss Merge() didn't bump bufUsed correctly
And, also allocate more memory for both the partial and full merges.
2016-03-15 17:09:40 -07:00
Marty Schoch
f1abf6beb3 facets now also have secondary sort
in case of term facets, secondary sort (after count) is on the term
for date and numberic facets, secondary sort is on the facet name

fixes #335
2016-03-14 12:02:30 -04:00
Marty Schoch
1817f28cfc rewrote to use same appraoch as numeric facets
see https://github.com/blevesearch/bleve/pull/134
2016-03-14 12:02:07 -04:00
Marty Schoch
0a343acb0d Merge pull request #355 from MachineShop-IOT/master
Minor fix to ensure full index path exists
2016-03-14 09:49:19 -04:00
Mark Mindenhall
c5b8544708 Minor fix to ensure full index path exists 2016-03-13 21:44:21 -06:00
Marty Schoch
cecdfcbc69 moving japanese analyzer to blevex package 2016-03-13 18:05:05 -04:00
Marty Schoch
0de657d3ca Merge pull request #343 from ikawaha/fix/ja_morph_kagome
Use a small version of kagome
2016-03-13 17:53:27 -04:00
Marty Schoch
b31f15002b Merge pull request #354 from steveyen/master
moss lowerLevelUpdate didn't handle batches of size 1
2016-03-13 11:43:46 -04:00
Steve Yen
c1597842d0 moss lowerLevelUpdate didn't handle batches of size 1 2016-03-11 15:47:23 -08:00
Marty Schoch
e76b1dd8f3 better logging on index mapping corruption 2016-03-11 16:36:43 -05:00
Marty Schoch
22a54caf45 fix handling of dynamic property in mappings of sub-documents
fixes #353
2016-03-11 12:18:24 -05:00
Marty Schoch
3627c92f08 more defensive merging of errors in search result status
necessary when combining after json serialization since the
combinatin of omitempty tag means empty map becomes nil map
2016-03-10 16:04:05 -05:00
Marty Schoch
f190473c5e Merge pull request #352 from steveyen/moss-RegistryCollectionOptions
moss CollectionOptions registry
2016-03-09 14:24:05 -05:00
Steve Yen
f1dac8b497 moss defaults to non-nil options.Log 2016-03-09 10:15:11 -08:00
Steve Yen
1d63c55f7c parse mossLowerLevelMaxBatchSize only when lower-level-store exists 2016-03-09 10:09:15 -08:00
Steve Yen
76b9365928 added moss RegistryCollectionOptions
The moss RegistryCollectionOptions allows applications to register
moss-related callback API functions and other advanced feature usage
at process initialization time.

For example, this could be used for moss's OnError(), OnEvent() and
logging callback options.
2016-03-09 09:40:29 -08:00
Marty Schoch
57919a77f5 add support for toggling Store/Index Dynamic in IndexMapping 2016-03-08 07:58:29 -05:00
Marty Schoch
d7292ed891 add support for gathering stats via map for easier consumption 2016-03-07 18:37:46 -05:00
Marty Schoch
e00577f265 change registry cache implementation to allow concurrent use
previously we just used a Go builtin map
this was not safe for concurrent read/write and upon upgrading
to Go 1.6 we were notified of the problem

fixes #349
2016-03-07 16:05:34 -05:00