URL restricted by robots.txt - But I don't have one?

Hi ,

I'm slightly confused about Robots.txt. I'm using Google Webmaster tools and it says the crawler error says "URL restricted by robots.txt". The strange thing is, I don't have a robots.txt file on my system. I haven't created one. Is there one already on the DASP servers or am I missing something?

Thanks

 

No, there is not a default robots.txt file in your account.

 

That's very strange. I decided to create one and resubmit to Google. Hopefully that should work

 

Yea, let us know if it works out.

 

Yup, adding the robots.txt file seemed to have fixed the problem. I checked my logs and Google's bots crawled the relevant pages.

 

Maybe they should change the error in that case to "URL unrestricted by robots.txt."