logo       
Google Custom Search
    AddThis Social Bookmark Button
-->

Re: plucene running under apache, out of open files?: msg#00074

Subject: Re: plucene running under apache, out of open files?
Minty wrote:

On 7/24/05, Marcus Ramberg <marcus-pUW9ajCR83puMpJDpNschA@xxxxxxxxxxxxxxxx> 
wrote:
Hey. I'm using plucene embedded in my wiki software, MojoMojo.. However,
it uses an obscene amount of open files, and often run out. I've been
trying to increase open files with little success. Is it normal for
plucene to have 8000 open files? The interface is using Plucene::Simple.

Have you adjusted mergefactor at all?  Try keeping it below 100.  This
should only apply to indexing.  Although, if you where to set it to
1000, you would end up with up to 1000 segments in your index dir, and
thus around 10,000 files.  Which it will try to open all at the same
time (unless I'm much mistaken, which is always an option) when you
load in your index for searching.

Also, check your index dir.  With the default mergefactor = 10, you
should see no more than around 100 files in there, possibly more if
you have indexed lots and lots of fields.  Better yet:

 cd /your/plucene/index/dir
 ls -ltr *.prx | wc

If you get values > 100, I would wonder why.
Hey. I havent adjusted mergefactor at all. My plucene index directory contains 121 files in total, which makes me wonder why it's keeping 9600 files open as we speak. Even if it has all files open in the 13 running apache instances, that should only be like 1500 files, so it must be opening the same files more than once.

Marcus


<Prev in Thread] Current Thread [Next in Thread>