Why might Googlebot get errors when trying to access my robots.txt file?
8 518
61.7
Google Webmasters634 тыс
Следующее
27.11.12 – 13 8682:17Популярные
165 дней – 5 0420:40
194 дня – 2 7180:23Опубликовано 26 ноября 2012, 14:14
I'm getting errors from Google Webmaster Tools about the Googlebot crawler being unable to fetch my robots.txt 50% of the time (but I can fetch it with 100% success rate from various other hosts). (On a plain old nginx server and an mit.edu host.)
Yang, Palo Alto, CA
Fetch as Google:
support.google.com/webmasters/...
Have a question? Ask it in our Webmaster Help Forum: groups.google.com/a/googleprod...
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com/googlewmc
More videos: youtube.com/GoogleWebmasterHel...
Webmaster Central Blog: googlewebmastercentral.blogspo...
Webmaster Central: google.com/webmasters
Yang, Palo Alto, CA
Fetch as Google:
support.google.com/webmasters/...
Have a question? Ask it in our Webmaster Help Forum: groups.google.com/a/googleprod...
Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com/googlewmc
More videos: youtube.com/GoogleWebmasterHel...
Webmaster Central Blog: googlewebmastercentral.blogspo...
Webmaster Central: google.com/webmasters
Свежие видео
2 дня – 55215:34
2 дня – 2 8080:58
8 дней – 17 9276:44
8 дней – 129 2075:41Случайные видео
95 дней – 1 2292:19
177 дней – 808 7699:41
06.02.23 – 3671:01
21.11.22 – 3 8642:29
05.12.21 – 3 374 39624:28
27.06.15 – 147 49911:15
2 дня – 1 106 11425:42
4 дня – 28 93828:11
5 дней – 2 3480:20
14 дней – 13 8390:56
16 дней – 10 59441:52
17 дней – 3 6201:01
2 дня – 13 5281:00