AI crawlers
ClaudeBot
Anthropic's crawler, used to collect web content for Claude. It is controlled through robots.txt like any other crawler.
Where to go next
Related terms
Definitions here are written and maintained by about-seo.com, owned and run by Trusted Media. Nothing on this page is generated per visitor.