logo       
Google Custom Search
    AddThis Social Bookmark Button

say no to robots: msg#00053

Subject: say no to robots
Hi all,
Can I tell wget to ignore robots.txt? If so how do I do it?
Also, if I have 10 different URL to retrieve from, can I specify all of
them in a file and ask wget to get them from the file and retrieve them
without any manual intervention? How do I do it?

Thanks a lot and bye.
With warm regards,
-Payal
-- 
"Visit GNU/Linux Success Stories"
www.geocities.com/rpayal99
Guest-Book Section Updated.



<Prev in Thread] Current Thread [Next in Thread>