Google’s Gary Illyes clarified on the Search Off The Record podcast that Google technically does not follow links. Instead, Google will extract the links, collect them in a database, and then check them later. Of course, most of you know this already and it doesn’t really matter much for SEO to know the difference but … Read more
Did you know that Google Search checks about four billion host names each and every day for robots.txt purposes? Gary Illyes said in the December Search Off The Record podcast “we have about four billion host names that we check every single day for robots.txt.” He said this at the 20:31 mark in the video. … Read more
Google’s Gary Illyes confirmed that Google does indeed check to see if an XML sitemap has a change in it before reprocessing the XML sitemap file. The reason Google does this is because it doesn’t want to waste resources parsing and processing a file that is not changed from the last time that file was … Read more
421
229
714
826
543