Special files in robots.txt

9 569
10.6
Опубликовано 20 июля 2020, 13:00
In this episode of Ask Google Webmasters, John Mueller goes over special files in robots.txt such as *.css, php.ini, and .htaccess, and explains why one does not have to and should not disallow these files from being crawled. The question was submitted by @svperflvid. Thank you!

Send us your questions on Twitter with the hashtag AskGooglebot and your question might be answered!
Google Search Central on Twitter → goo.gle/3f4Z0a8

Watch more AskGooglebot episodes → goo.gle/2OjWcvS
Subscribe to the Google Search Central Channel → goo.gle/SearchCentral

#AskGooglebot
автотехномузыкадетское