AI crawlers
GPTBot
OpenAI's crawler, used to collect web content for its models. Blocking it in robots.txt is allowed and stops that collection without affecting normal search crawling.
Where to go next
Related terms
Definitions here are written and maintained by about-seo.com, owned and run by Trusted Media. Nothing on this page is generated per visitor.