Google introduced Google-Extended, a new control that allows web publishers to manage how their content is used for generative AI use cases such as Bard and Vertex AI, as well as "future generations of models." The feature provides more choice and control over website content, Google said. "A website administrator can choose whether to help these AI models become more accurate and capable over time." Similar to OpenAI's GPTBot, you can use robots.txt to block Google-Extended.

Ad

User-agent: Google-Extended
Disallow: /

It's not clear from the announcement if blocking Google-Extended will cause Bard and SGE to stop using your content in chat, or if it's just about training data.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.