0
0
bleve/index/scorch/segment
Steve Yen e82774ad20 scorch zap AnalysisResultsToSegmentBase()
AnalysisResultsToSegmentBase() allows analysis results to be directly
converted into a zap-encoded SegmentBase, which can then be introduced
onto the root, avoiding the creation of mem.Segment data structures.
This leads to some reduction of garbage memory allocations.

The grouping and sorting and shaping of the postings list information
is taken from the mem.Segment codepaths.

The encoding of stored fields reuses functions from zap's merger,
which has the largest savings of garbage memory avoidance.

And, the encoding of tf/loc chunks, postings & dictionary information
also follows the approach used by zap's merger, which also has some
savings of garbage memory avoidance.

In future changes, the mem.Segment dependencies will be removed from
zap, which should result in a smaller codebase.
2018-03-09 15:22:30 -08:00
..
mem scorch mem processDocument reuses fieldLens/docMap arrays 2018-03-08 13:04:51 -08:00
zap scorch zap AnalysisResultsToSegmentBase() 2018-03-09 15:22:30 -08:00
empty.go MB-28162: Provide API to estimate memory needed to run a search query 2018-03-06 13:53:42 -08:00
int_test.go initial version of scorch which persists index to disk 2017-12-06 18:33:47 -05:00
int.go initial version of scorch which persists index to disk 2017-12-06 18:33:47 -05:00
segment.go MB-28162: Provide API to estimate memory needed to run a search query 2018-03-06 13:53:42 -08:00