Re: nutch -threads in hadoop

Brian Tingle wrote:
> Hey,
>
>  
>
> I'm playing around the nutch on hadoop; when I go 
>
> hadoop jar nutch-1.0.job org.apache.nutch.crawl.Crawl -threads ... is
> that threads per node or total threads for all nodes?

Threads per map task - if you run multiple map tasks per node then you 
will get numThreads * numMapTasks per node.

So be careful to set it to a number that doesn't overwhelm your network ;)

--
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com