Sreekanth Sivasankaran
1775602958
posting iterator array positions clean up,
...
max segment size limit adjustment for hit-1
optimisation
2018-03-15 14:40:00 +05:30
Sreekanth Sivasankaran
debbcd7d47
adding maxsegment size limit checks
2018-03-13 17:35:54 +05:30
Marty Schoch
0bcfb15ace
Merge pull request #754 from sreekanth-cb/mergeplan_edge_tuning
...
tuning the edge for merge-task execution loop
2018-02-08 10:59:03 -05:00
Sreekanth Sivasankaran
07274c036d
tuning the edge for merge-task execution loop
...
Adjusting the merge task creation loop to accommodate
the newly merged segments so that the eventual merge
results/ number of segments stay within the calculated budget.
2018-02-06 13:48:16 +05:30
Steve Yen
fdb240f5f9
more zap merge-planner CalcBudget tests at larger sizes
...
Helps provide a sense of how # of segments grows as # of documents
grows. Ex: 1B docs => budget of 54 segments.
2018-02-05 10:02:47 -08:00
Steve Yen
867bb2c031
scorch mergeplan explicitly weeds out empty segments
...
Rather than waiting on scoring to weed out empty segments, this commit
does the weeding out of empty segments explicitly and up front.
2017-12-18 11:33:19 -08:00
Steve Yen
e98602600d
scorch mergeplan added TierGrowth option
...
Previously, CalcBudget() was treating
MergePlanOptions.SegmentsPerMergeTask as the growth factor while
computing the idealized staircase of segments.
This change introduces a TierGrowth option to MergePlanOptions for
more control and so that SegmentsPerMergeTask can be tweaked
independently of the tier growth factor.
2017-12-16 14:22:15 -08:00
Steve Yen
0539744e90
scorch mergeplan.ToBarChart() refactored to callable API
...
Refactored out API so it's usable from other places.
2017-12-16 08:39:10 -08:00
Steve Yen
45c212a0c2
scorch mergeplan package comments tweak
...
Moving the package comment for mergeplan to the right place.
2017-12-15 13:25:39 -08:00
Steve Yen
be7dd36ac6
mergeplan: more tests and bargraph tweaks
2017-12-12 10:37:27 -08:00
Steve Yen
59a1e26300
mergeplan: scoring implemented
2017-12-12 10:37:27 -08:00
Steve Yen
3461fb741f
mergeplan: a placeholder planner that merges all segments
...
A stepping stone to fleshing out the API contract.
2017-12-11 14:53:08 -08:00