Spider is an robot that travels the web examining the websites in order to add them to a search engine database and rank them according to the specific ranking criteria for that search engine. The spiders will periodically come back to your site once indexed in their database. That is why it is important to constantly refresh your content, because the spiders will stop coming to your site if your content remains the same.
What is a spider?
- Thread starter sneha1234
- Start date