Understanding Google Search Console's Crawl State: How Crawl Requests Change with Discovery

 In Google Search Console, the Crawl state is a crucial aspect that helps website owners understand how Google's web crawler interacts with their site. One significant factor influencing this state is the percentage of Crawl requests, which is further divided into two categories: "Refresh" and "Discovery." This article aims to shed light on how Google increases or decreases the percentage of these crawl requests based on website updates and content changes.

Accessing the Crawl State Report:
    To begin, log in to your Google Search Console account and navigate to the Crawl state report. This report provides valuable insights into how Google's web crawler interacts with your website.

Understanding "By Purpose":
    Within the Crawl state report, you'll find a section labeled "By purpose," which breaks down the Crawl requests into two categories: "Refresh" and "Discovery."

Analyzing a Specific Example - Date: 3rd July 2023: a) Refresh - 89%, Discovery - 11%:


During this period, we made significant updates to various sections of our website, including the footer section, Executive leadership page, Home page background video, and an Australian indigenous section. As a result, the percentage of Crawl requests classified as "Discovery" increased to 11%.

Another Case - Date: January 2023: a) Refresh - 96%, Discovery - 4% :
    

During this period, no substantial updates were made to our website. As a consequence, the percentage of Crawl requests classified as "Discovery" remained low, at only 4%.

The Crawl state in Google Search Console provides invaluable insights into how Google's web crawler interacts with our website. By analyzing the percentage of Crawl requests, specifically "Refresh" and "Discovery," we can better understand how our content changes impact the crawler's behavior. When updates are made to the website, such as adding new sections or modifying existing content, the percentage of "Crawl requests: Discovery" tends to increase, indicating that Google is actively exploring and indexing these changes. On the other hand, periods with fewer updates result in a lower percentage of "Crawl requests: Discovery." Understanding these patterns can help us optimize our website and ensure that Google effectively crawls and indexes our most relevant content.

Comments

Popular posts from this blog

How I Achieved First Page First Position for High Search Volume Keyword on Google SERP

Crawled - Currently Not Indexed

Crawled - Currently not indexed - My Experience Troubleshooting the Issue