0
0
Commit Graph

1124 Commits

Author SHA1 Message Date
Marty Schoch
d8ccda94f1 Merge pull request #373 from MachineShop-IOT/master
Add compact method to goleveldb store
2016-05-18 09:06:53 -04:00
Mark Mindenhall
3aa1d72233 Add compact method to goleveldb store 2016-05-17 16:58:17 -06:00
Marty Schoch
c6666d4674 Merge pull request #372 from slavikm/master
Load the document only once for both fields and highlighter
2016-04-29 15:10:37 -04:00
slavikm
f2aba116c4 Make top score collector about 7 times faster 2016-04-29 09:46:47 -07:00
slavikm
6d830a9f3e Load the document only once for both fields and highlighter 2016-04-28 11:12:33 -07:00
Marty Schoch
760057afb6 parse search results by converting strings back to errors 2016-04-26 17:56:37 -04:00
Marty Schoch
3badeb5fe1 add Validate() method to SearchRequest 2016-04-22 20:33:21 -04:00
Marty Schoch
8f8bb91439 simplify date parsing in queries, add date to query string
parsing of date ranges in queries no longer consults the
index mapping.  it was deteremined that this wasn't very useful
and led to overly complicated query syntax/behavior.

instead, applications get set the datetime parser used for
date range queries with the top-level config QueryDateTimeParser

also, we now support querying date ranges in the query string,
the syntax is:

field:>"date"

>,>=,<,<= operators are supported
the date must be surrounded by quotes
and must parse in the configured date format
2016-04-22 17:12:10 -04:00
Marty Schoch
d0c6dbc9cf unregister index from expvar stats on close 2016-04-20 11:43:14 -04:00
Marty Schoch
709b418823 properly initialize index stats object for in memory indexes 2016-04-20 11:37:51 -04:00
Marty Schoch
53f7eb2891 multi-term searches check DisjunctionMaxClauseCount earlier
regexp, fuzzy and numeric range searchers now check to see if
they will be exceeding a configured DisjunctionMaxClauseCount
and stop work earlier, this does a better job of avoiding
situations which consume all available memory for an operation
they cannot complete
2016-04-18 10:06:34 -04:00
Marty Schoch
c7ae842b33 fix marshaling of MatchNone queries 2016-04-16 20:51:27 -04:00
Marty Schoch
95b03f9b54 Merge pull request #370 from mschoch/safermetrics
do not put +/-Inf or NaN values into the stats map
2016-04-15 13:56:25 -04:00
Marty Schoch
73b514fa4f do not put +/-Inf or NaN values into the stats map 2016-04-15 13:39:30 -04:00
Marty Schoch
18b50305e4 update travis to build with deps specified in manifest 2016-04-08 17:06:25 -04:00
Marty Schoch
d06f4b3860 fix manifest versions
i was too eager to commit the manifest and do the release
the original manifest contained "too new" versions for some
of the deps
2016-04-08 16:49:18 -04:00
Marty Schoch
7ec37d6533 add support for wildcard and regexp queries to query string
you can now use terms like:

test?string*

and similar text in query strings to perform wildcard
searches.  also if you use:

/aregexp/

it will perform a regexp search as well
2016-04-08 15:56:02 -04:00
Marty Schoch
2f59b75ce4 Merge branch 'mschoch-fix-data-race' 2016-04-08 15:32:47 -04:00
Marty Schoch
b8a2fbb887 fix data race in bleve batch reuse
Currently bleve batch is build by user goroutine
Then read by bleve gourinte
This is still safe when used correctly
However, Reset() will modify the map, which is now a data race

This fix is to simply make batch.Reset() alloc new maps.
This provides a data-access pattern that can be used safely.
Also, this thread argues that creating a new map may be faster
than trying to reuse an existing one:

https://groups.google.com/d/msg/golang-nuts/UvUm3LA1u8g/jGv_FobNpN0J

Separate but related, I have opted to remove the "unsafe batch"
checking that we did.  This was always limited anyway, and now
users of Go 1.6 are just as likely to get a panic from the
runtime for concurrent map access anyway.  So, the price paid
by us (additional mutex) is not worth it.

fixes #360 and #260
2016-04-08 15:32:13 -04:00
Marty Schoch
617fcf693e add initial manifest 2016-04-08 15:03:05 -04:00
Marty Schoch
74b7872987 fix marshaling of MatchAll queries 2016-04-07 18:20:35 -04:00
Marty Schoch
36170a4736 more gofmt simplifications 2016-04-03 00:03:33 -04:00
Marty Schoch
dd209dcbf2 tweak syntax to make older go vet happy 2016-04-02 23:54:36 -04:00
Marty Schoch
4433964f78 tweak syntax 2016-04-02 23:17:47 -04:00
Marty Schoch
020ea1b8ee tweak syntax slightly 2016-04-02 23:08:43 -04:00
Marty Schoch
1c69112820 a few more gofmt simplifications 2016-04-02 22:48:00 -04:00
Marty Schoch
2a703376ea fix ineffectual assignments 2016-04-02 22:42:56 -04:00
Marty Schoch
7892882519 fix typos 2016-04-02 21:59:30 -04:00
Marty Schoch
194ee82c80 gofmt simplifications 2016-04-02 21:54:33 -04:00
Marty Schoch
7594daad01 adding goreportcard 2016-04-02 21:01:23 -04:00
Marty Schoch
0b171c85da change "simple" analyzer to use "letter" tokenizer
this change improves compatibility with the simple analyzer
defined by Lucene.  this has important implications for
some perf tests as well as they often use the simple
analyzer.
2016-03-31 15:13:17 -04:00
Marty Schoch
d774f980d3 search request JSON omitting size, now defaults to 10
this change only affects JSON parsing, any search request which
omits the size field entirely now defaults to 10 which
is the same behavior as NewSearchRequest()

0 is still a valid size, but must be set explicitly
2016-03-31 09:56:06 -04:00
Marty Schoch
2b82387eae export the Validate method on mapping objects 2016-03-28 17:14:41 -04:00
Marty Schoch
639fb1ab89 remove NativeMergeOperator from core, it requires unsafe 2016-03-24 12:06:43 -04:00
Marty Schoch
1f0509fe48 Merge pull request #365 from bcampbell/documenting
some minor godoc additions
2016-03-22 18:10:40 -04:00
Ben Campbell
4fafb2be3f Merge branch 'master' into documenting 2016-03-23 10:48:09 +13:00
Marty Schoch
724684a4f1 additional firestorm fixes for 64-bit alignment
part of #359
2016-03-20 11:02:13 -04:00
Marty Schoch
3dc64de478 moved fields requiring 64-bit alignment to start of struct
several data structures had a pointer at the start of the struct
on some 32-bit systems, this causes the remaining fields no longer
be aligned on 64-bit boundaries

the fix identifed by @pmezard is to put the counters first in the
struct, which guarantees correct alignment

fixes #359
2016-03-20 10:38:28 -04:00
Marty Schoch
5ea6b063ad Merge pull request #358 from steveyen/master
MB-18715 - moss Merge fix
2016-03-15 20:26:24 -04:00
Steve Yen
be2800a8e4 MB-18715 - moss Merge() didn't bump bufUsed correctly
And, also allocate more memory for both the partial and full merges.
2016-03-15 17:09:40 -07:00
Marty Schoch
f1abf6beb3 facets now also have secondary sort
in case of term facets, secondary sort (after count) is on the term
for date and numberic facets, secondary sort is on the facet name

fixes #335
2016-03-14 12:02:30 -04:00
Marty Schoch
1817f28cfc rewrote to use same appraoch as numeric facets
see https://github.com/blevesearch/bleve/pull/134
2016-03-14 12:02:07 -04:00
Marty Schoch
0a343acb0d Merge pull request #355 from MachineShop-IOT/master
Minor fix to ensure full index path exists
2016-03-14 09:49:19 -04:00
Mark Mindenhall
c5b8544708 Minor fix to ensure full index path exists 2016-03-13 21:44:21 -06:00
Marty Schoch
cecdfcbc69 moving japanese analyzer to blevex package 2016-03-13 18:05:05 -04:00
Marty Schoch
0de657d3ca Merge pull request #343 from ikawaha/fix/ja_morph_kagome
Use a small version of kagome
2016-03-13 17:53:27 -04:00
Marty Schoch
b31f15002b Merge pull request #354 from steveyen/master
moss lowerLevelUpdate didn't handle batches of size 1
2016-03-13 11:43:46 -04:00
Steve Yen
c1597842d0 moss lowerLevelUpdate didn't handle batches of size 1 2016-03-11 15:47:23 -08:00
Marty Schoch
e76b1dd8f3 better logging on index mapping corruption 2016-03-11 16:36:43 -05:00
Marty Schoch
22a54caf45 fix handling of dynamic property in mappings of sub-documents
fixes #353
2016-03-11 12:18:24 -05:00