OSDir


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[users@httpd] 0 length robot.txt


This is probably a coincidence, but I had one of my hosted sites (with no php code anywhere, and certainly no .php files) returning a script error on load instead of showing the non-php webpage:

[proxy_fcgi:error] [pid 88148] [client xx.xx.xx.xx:63137] AH01071: Got error 'Primary script unknown\n’

And it would display a blank page for a few seconds, then “File Not Found” would appear. There was no HTTP error code.

Other hosted sites, also not using php, didn’t have this problem, and sites that did use php were working fine.

All sites are configured to allow php, and have an fcgi in their configuration:

   DocumentRoot ${WEBROOT}
   ProxyPassMatch ^/(.*\.php)$ fcgi://127.0.0.1:9000/${WEBROOT}$1

On the problem site, if I commented out the ProxyPassMatch line and reloaded apache, the site would load.

Confusing.

Not being sure what was causing this one one specific site, I started comparing the directory structure, .htaccess, and anything I could look at to see what was different about this particular site and I noticed that it had a zero length robots.txt file in the webroot, which no other site had.

Removing that file made the site load properly.

I still get many script errors in the error log, but these mostly have a referer [sic] at the end and are obviously attempts to hack into the page:

[proxy_fcgi:error] [pid 42901] [client 178.137.92.187:61783] AH01071: Got error 'Primary script unknown\n', referer: /www/XXX/license.php

[proxy_fcgi:error] [pid 18168] [client 74.71.9.14:59624] AH01071: Got error 'Primary script unknown\n'
[core:info] [pid 43056] [client 74.71.9.14:59637] AH00128: File does not exist: /www/XXX/apple-touch-icon-120x120-precomposed.png

But I still get a few bare ones:

[Wed Oct 03 08:13:05.504129 2018] [proxy_fcgi:error] [pid 43364] [client 74.71.9.14:57753] AH01071: Got error 'Primary script unknown\n'
[Wed Oct 03 09:17:36.194394 2018] [proxy_fcgi:error] [pid 42840] [client 54.36.148.74:60192] AH01071: Got error 'Primary script unknown\n'
[Wed Oct 03 10:08:08.834583 2018] [proxy_fcgi:error] [pid 18168] [client 74.71.9.14:59624] AH01071: Got error 'Primary script unknown\n'
[Wed Oct 03 10:17:17.791282 2018] [proxy_fcgi:error] [pid 43056] [client 180.76.15.30:29494] AH01071: Got error 'Primary script unknown\n'
[Wed Oct 03 10:40:17.322634 2018] [proxy_fcgi:error] [pid 42840] [client 74.71.9.14:64211] AH01071: Got error 'Primary script unknown\n'
[Wed Oct 03 11:27:58.098639 2018] [proxy_fcgi:error] [pid 18168] [client 202.46.50.182:22728] AH01071: Got error 'Primary script unknown\n'
[Wed Oct 03 11:33:13.054967 2018] [proxy_fcgi:error] [pid 43056] [client 123.125.71.77:21018] AH01071: Got error 'Primary script unknown\n'

(The 74.71.9.14 IP has made more than 50,000 requests for non-existent files on this hosted domain, sadly it is a residential IP from RoadRunner, and they are worthless to deal with, regardless of how often they change their company name)

Why would a blank robots.txt cause this issue? Or is there something else going on here and this is just a weird coincidence?

-- 
There's a race of men that don't fit in, A race that can't stay still So
they break the hearts of kith and kin, And they roam the world at will.



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx