gibheer/bleve
0
0
Fork 0
Code
7ae696d661
bleve/index/firestorm
History
Steve Yen 7ae696d661 firestorm lookuper notified via batch 
Previously, the firestorm.Batch() would notify the lookuper goroutine
on a document by document basis.  If the lookuper input channel became
full, then that would block the firestorm.Batch() operation.

With this change, lookuper is notified once, with a "batch" that is an
[]*InFlightItem.

This change also reuses that same []*InFlightItem to invoke the
compensator.MutateBatch().

This also has the advantage of only converting the docID's from string
to []byte just once, outside of the lock that's used by the
compensator.

Micro-benchmark of this change with null-firestorm bleve-blast does
not show large impact, neither degradation or improvement.
2016-01-02 12:21:24 -08:00
..
analysis_test.go fix indexing bug with data coming from arrays 2015-12-21 14:59:32 -05:00
analysis.go firestorm.Analyze() converts docID to bytes only once 2016-01-02 12:21:24 -08:00
benchmark_boltdb_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
benchmark_common_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
benchmark_cznicb_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
benchmark_forestdb_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
benchmark_goleveldb_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
benchmark_gorocksdb_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
benchmark_gtreap_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
benchmark_leveldb_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
benchmark_null_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
comp.go firestorm lookuper notified via batch 2016-01-02 12:21:24 -08:00
dict_updater_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
dict_updater.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
dictionary_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
dictionary.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
dump_test.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
dump.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
field_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
field.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
firestorm_rows.pb.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
firestorm_rows.proto made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
firestorm_test.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
firestorm.go firestorm lookuper notified via batch 2016-01-02 12:21:24 -08:00
firestorm.md firestorm.md markdown fixes 2016-01-01 09:57:59 -08:00
garbage_test.go firestore: reproducer for division by zero on GC 2015-12-25 11:33:46 +07:00
garbage.go firestore: fix #296 for division by zero on GC 2015-12-25 11:34:19 +07:00
internal_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
internal.go correctly prefix internal rows with 'i' and print them in debug 2015-11-30 10:17:15 -05:00
lookup_test.go firestorm lookuper notified via batch 2016-01-02 12:21:24 -08:00
lookup.go firestorm lookuper notified via batch 2016-01-02 12:21:24 -08:00
merge_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
merge.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
reader_dict_test.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
reader_dict.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
reader_docs_test.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
reader_docs.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
reader_terms_test.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
reader_terms.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
reader.go fix issues identified by errcheck 2015-11-24 14:32:33 -05:00
stats.go make existing integration tests work with firestorm 2015-12-01 12:29:56 -05:00
stored_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
stored.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
termfreq_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
termfreq.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
util.go include space after prefix in log output 2015-11-30 10:17:48 -05:00
version_test.go made index type configurable + first version of firestorm 2015-08-25 14:52:42 -04:00
version.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
warmup_test.go Merge branch 'master' into firestorm 2015-10-28 11:26:01 -04:00
warmup.go fix bug in warmup which led to docs being deleted 2015-11-30 10:18:14 -05:00