Why might Googlebot get errors when trying to access my robots.txt file?
8 648
62.7
Google Webmasters681 тыс
Следующее
27.11.12 – 13 8812:17Популярные
108 дней – 3 96028:07
116 дней – 1 77721:52Опубликовано 26 ноября 2012, 14:14
I'm getting errors from Google Webmaster Tools about the Googlebot crawler being unable to fetch my robots.txt 50% of the time (but I can fetch it with 100% success rate from various other hosts). (On a plain old nginx server and an mit.edu host.)
Yang, Palo Alto, CA
Fetch as Google:
support.google.com/webmasters/...
Have a question? Ask it in our Webmaster Help Forum: groups.google.com/a/googleprod...
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com/googlewmc
More videos: youtube.com/GoogleWebmasterHel...
Webmaster Central Blog: googlewebmastercentral.blogspo...
Webmaster Central: google.com/webmasters
Yang, Palo Alto, CA
Fetch as Google:
support.google.com/webmasters/...
Have a question? Ask it in our Webmaster Help Forum: groups.google.com/a/googleprod...
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com/googlewmc
More videos: youtube.com/GoogleWebmasterHel...
Webmaster Central Blog: googlewebmastercentral.blogspo...
Webmaster Central: google.com/webmasters
Свежие видео
2 дня – 3 2911:34
3 дня – 2 5530:16
3 дня – 37 4580:27
4 дня – 4 1580:31
4 дня – 4451:17
4 дня – 3732:45Случайные видео
72 дня – 143 77210:36
93 дня – 6 10618:35
21.12.22 – 207 7287:24
25.02.22 – 5726:56
12.04.20 – 62 9012:31
3 дня – 17 95737:01
3 дня – 40 06116:57
5 дней – 11 1000:12
7 дней – 5060:20
11 дней – 4387:20
13 дней – 25 8565:07
