Re: SegmentReader field cache merging?

+1

We're already able to warm a reader in the the newly merged segment,
in the BG and not delaying any near real-time reopens in the
meantime... but if we can merge FieldCache entries directly in RAM
this ought to be a good speedup over re-un-inverting the merged
segment.

Mike

On Thu, Jul 30, 2009 at 6:35 PM, Mark Miller<markrmiller@xxxxxxxxx> wrote:
>>> Perhaps in separate patch that's limited to field cache merging
>>> we can simply modify our existing field cache code (i.e. not
>>> rewrite field caching in general) (in conjunction with
>>> IW.getReader and segment merging) to automatically (or with a
>>> settings callback in IW for which fields should be auto merged)?
>
> +1 - especially if you able to work on it soon rather than later. 831 won't
> be a reality for some time would be my prediction.
> It doesn't seem like you would need it to support merging FieldCaches
> either. You would just prepopulate the new merged segment with values from
> the previous segments and then those would get garbage collected when no
> longer referenced right?
>
> Jason Rutherglen wrote:
>>
>> I know this has been somewhat stuck in LUCENE-831 which seems to
>> have blown up quite a bit over time and is untouched of late?
>>
>> Perhaps in separate patch that's limited to field cache merging
>> we can simply modify our existing field cache code (i.e. not
>> rewrite field caching in general) (in conjunction with
>> IW.getReader and segment merging) to automatically (or with a
>> settings callback in IW for which fields should be auto merged)?
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-dev-unsubscribe@xxxxxxxxxxxxxxxxx
>> For additional commands, e-mail: java-dev-help@xxxxxxxxxxxxxxxxx
>>
>>
>
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@xxxxxxxxxxxxxxxxx
> For additional commands, e-mail: java-dev-help@xxxxxxxxxxxxxxxxx
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@xxxxxxxxxxxxxxxxx
For additional commands, e-mail: java-dev-help@xxxxxxxxxxxxxxxxx