Webmaster tools robots txt unreachable

WMT seems to lose things. I don't often go there and was surprised to see some of my sites were unverified. I thought it was because G has renamed the verification file to uppercase while I had the old lowercase filename.

Renamed the file and WMT is happy. Junior Member joined:June 17, posts votes: 0. My site is still verified. Googlebot must not be reading the robots. My ecommerce software uses JS to start it and injects a adding pathway through the cgi-bin - for example. Senior Member joined:May 26, posts votes: 0. If you're seeing urls in WMT that are blocked by robots.

That's a good idea. Ahmad Ahmadi Ahmad Ahmadi 11 1 1 bronze badge. Add a comment. Active Oldest Votes. If the tool requires a robots. Improve this answer. Shane Madden Shane Madden k 12 12 gold badges silver badges bronze badges. Sign up or log in Sign up using Google. Sign up using Facebook. Sign up using Email and Password. And if you fetch www. Add a comment. Active Oldest Votes. Improve this answer. Miroslav Miroslav 1, 1 1 gold badge 13 13 silver badges 26 26 bronze badges.

Igal Zeifman Igal Zeifman 1, 7 7 silver badges 8 8 bronze badges. Sign up or log in Sign up using Google. Sign up using Facebook. Sign up using Email and Password. Connect and share knowledge within a single location that is structured and easy to search.

Network unreachable: robots. Please ensure that it is accessible or remove it completely. Yet, I can access both my robots. Anyone knows? Unfortunately, the fact you can access the files doesn't guarantee that Google can. Are you doing any user-agent detection or similar that may be interfering? Try downloading a page with the Fetch as Googlebot tool, and see if it encounters any problems — if that works, that suggests anything else should, too.

Depending on your site, there may be a few days or more between Google's attempts to access the file. As such, it could be there was an issue then that has disappeared now like a server outage.

So if the Fetch tool doesn't suggest any problems, I'd consider waiting a while to see if the issue recurs before doing more. You probably want to check with your site's hoster to find out more.