Why might Googlebot get errors when trying to access my robots.txt file?
8 598
62.3
Google Webmasters673 тыс
Следующее
27.11.12 – 13 8792:17Популярные
17 дней – 3 82537:11
130 дней – 9 7916:57Опубликовано 26 ноября 2012, 14:14
I'm getting errors from Google Webmaster Tools about the Googlebot crawler being unable to fetch my robots.txt 50% of the time (but I can fetch it with 100% success rate from various other hosts). (On a plain old nginx server and an mit.edu host.)
Yang, Palo Alto, CA
Fetch as Google:
support.google.com/webmasters/...
Have a question? Ask it in our Webmaster Help Forum: groups.google.com/a/googleprod...
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com/googlewmc
More videos: youtube.com/GoogleWebmasterHel...
Webmaster Central Blog: googlewebmastercentral.blogspo...
Webmaster Central: google.com/webmasters
Yang, Palo Alto, CA
Fetch as Google:
support.google.com/webmasters/...
Have a question? Ask it in our Webmaster Help Forum: groups.google.com/a/googleprod...
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com/googlewmc
More videos: youtube.com/GoogleWebmasterHel...
Webmaster Central Blog: googlewebmastercentral.blogspo...
Webmaster Central: google.com/webmasters
Свежие видео
3 дня – 556 5828:53
4 дня – 193 5043:20
5 дней – 2 2870:26
9 дней – 1 1320:28
10 дней – 2 85039:01Случайные видео
281 день – 889 63810:30
365 дней – 13 0421:01
22.05.23 – 7 705 21219:09
08.05.22 – 41 5927:59
06.12.21 – 6 6640:15
31.08.06 – 46 6484:46
1 день – 924 10723:53
3 дня – 1 8380:59
5 дней – 6 9004:07
