Luigi Suardi wrote:
> i am seeing a strange behavior from wget.
> a google search such as
> http://www.google.com/search?hl=en&ie=ISO-8859-1&q=suardi
> works fine in the IE browser, but when i pass this
> url to wget i get the error below:
It appears that Google specifically blocks the default user agent sent by
wget. Try adding the following to your wget command line:
-U "Mozilla"
You can send the entire string sent by a browser such as:
-U "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 4.0)"
but, just telling Google that you're coming in using a "Mozilla" user agent
is sufficient. You could also tell it your user agent is "Luigi" and it
works just as well. <grin>
If you want to mess with them, you could say: -U "GoogleBot" <evil grin>
Tony
|
