Google has made an update to its Google-Extended section of the Google crawler (user agent) search documentation to change the references of “Bard” to “Gemini” because of the product name change. Google also clarified that Google Extended has no impact or effect on Google Search. Google added this new line that reads, “Google-Extended does not … Read more
Google recently updated the documentation of its Google-Extended web crawler user agent, reflecting changes in product naming and clarifying the impact on search, which may be a concern for those who choose to block the crawler. The updated documentation offers clearer guidance on controlling content access for use in AI model training. Google-Extended User Agent … Read more
More than 250 websites now block Google-Extended, the “standalone product token” Google introduced Sept. 28 to let you block Bard, Vertex AI generative APIs and future generations of ****** from accessing your content. That’s according to research shared exclusively with Search Engine Land by the Detailed.com team. Why we care. There has been much debate and discussion … Read more
A couple of weeks ago Google released a new robots.txt directive to tell Google not to use your content for Bard or other AI Google projects – Google-Extended. The Google Search Generative Experience does not currently use Google-Extended, Google told me. That means SGE’s AI-generated answers can and will continue to show unless you block … Read more
Google-Extended, the new standalone product token, to tell Google through your robots.txt to not use your site content for Bard and Vertex AI and other AI projects does not work for the AI-answers and snapshots provided in the Search Generative Experience. Google told us that Google-Extended does not work for SGE. “SGE is a Search … Read more
Google has announced a new Googlebot, a new Google crawler, named Google-Extended that you can use to control if your content can help improve Bard and Vertex AI generative APIs or future Google AI products. So if you want to disallow Bard from using your content, you specify so in your robots.txt with the user … Read more
Google today announced a new “standalone product token”, Google-Extended, that lets you control whether Bard and Vertex AI can access the content on your site. This seems to be the end result of a “public discussion” Google initiated in July, when the company promised to gather “voices from across web publishers, civil society, academia and … Read more
421
229
714
826
543