Many new bloggers confuse themselves about various process that happens in Search Engine Optimization. Here in this post, we would like to explain about three terms, Crawling, Indexing and Search Engine Placements. This is primarily applicable to Google, but relatively adapted by other search engines also. After reading about these three terms, you will understand how does Google or any other search engine find web pages matching your search query, and determine the order of search results.
What is Crawling?
Crawling is the process by which the search engine arms go through a new website or blog once it gets a ping that the specific parent URL is updated. In case of Google, Crawling is a process in which Googlebot discovers new and updated pages to be added to the Google index by using a huge set of computers to "crawl" billions of pages on the web. Googlebot uses an algorithmic process in which computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.
Frequency of Crawling:
Googlebot designs its crawl process depending on a list of web page URLs,based on the previous crawl processes. The Sitemap grabs the data provided at the webmasters tool page. When ever Googlebot visits each of these websites it detects links on each page and adds them to its list of pages to crawl. One of the main feature of Googlebot is that it lists new sites, changes to existing sites, and dead links. Also, Googlebot determines the content tags, photo tags, Title tags etc.
What is Indexing?
After crawling, Googlebot processes each of the pages it crawls in order to compile a massive index of all the words it crawls and the location on each page with keyword density, key content tags and attributes, such as Title tags and ALT attributes. The indexing then happens after identifying the density and relative importance of each Page.
How your Page appears in Search Engine Results?
While a person search a term in the search Engine, then say for example, Google search the index for matching pages and return relevant results.In Google, “Relevancy” is determined by more than 200 factors like PageRank. Build your site so that bots like, Googlebots can crawl, identify the content keywords and rank it to the top of search engine results.
More to read: