Technical
Crawler
A program that fetches pages and follows links. Also called a spider or bot.
Where to go next
Related terms
Definitions here are written and maintained by about-seo.com, owned and run by Trusted Media. Nothing on this page is generated per visitor.