I should start by saying this is super dangerous and you probably should not do this unless you really know what you are doing and why you are doing it. But John Mueller of Google said on Twitter, “The best way to block the traffic from search for specific URLs completely is to disable DNS … Read more
Google Search Advocate John Mueller suggests three ways to prevent potentially inaccurate AI chatbot content from being indexed. Website owners should be mindful of potential issues caused by AI chatbots that could impact the visibility and search presence of their websites. Mueller suggests the use of a ‘robotted iframe’, ‘robotted JavaScript file/resource’, or ‘data-nosnippet’ to … Read more
In the past few days, Google Search has dropped over half of the indexed URLs from Twitter from the Google Search index. This was done after Twitter added a “feature” on Friday afternoon only to display tweets to signed-in and registered users; also, the throttling going on at Twitter right now is probably not helping. … Read more
Google’s John Mueller went on a bit of a rant on Reddit on the topic of having your internal search result pages crawlable and indexable. As you know, in general, Google does not want to index search results but John said, this is especially true for search result pages that have no results found. In … Read more
Since ChatGPT launched, the debate around the “fair use” of public website content for AI training – and whether this is plagiarism – has raged. That debate has only gotten louder and more intense since OpenAI announced ChatGPT plugins on March 23. One of OpenAI’s plugins is an official ChatGPT-hosted web browser. It will allow … Read more
With all the talk about ChatGPT and other AI bots, did you know that there is an OpenAI ChatGPT bot and it respects the robots.txt protocol? So if you want, you can block OpenAI’s ChatGPT bot from crawling, indexing and using your content and data from your website. This will block the ChatGPT plugins specifically. … Read more
421
229
714
826
543