Search on Google, Bing, and The search engines!, on how to have your site added with regard to crawled and

Typically, how a search engine works is usually sending out a “spider” to retrieve as many web pages as is