Discovered - Currently Not Indexed

-

This is a great example of just that how to fix the “Discovered – Currently Not Indexed” status. 

The error message was "Discovered - currently not indexed" for the post - https://scgroup.global/blog/4-essential-security-services/, when analyzed the URL by "URL inspection tool" in Google search console.


 The blog post is published on 7 June 2022. But the blog is not indexed in Google around 80 days.


As Google documentation says, "Discovered - currently not indexed" - https://support.google.com/webmasters/answer/7440203?hl=en
Quoted: "The page was found by Google, but not crawled yet. Typically, Google wanted to crawl the URL but this was expected to overload the site; therefore Google rescheduled the crawl. This is why the last crawl date is empty on the report."

Sorted out all possible reasons for excluded page:

  • Step1: Analyzed the crawlability of the post is fine and checked for the http headers, meta for robots (“noindex” tags if any) and robots.txt and all was fine.  
  • Step2: Requested to review the blog post content quality.
  • Step3: Analyzed the health of our website server and Firewall log.

Our Firewall support team found:

  1. "206 response codes" in our firewall log for the particular blog post.
  2. "403 response codes" in our firewall log for the particular blog post.
  3. "304 response codes" from the hosting server sometimes for the site when Googlebot is making requests.


  • 206 - Partial Content: A status code of 206 is a response to a request for part of a document. This is used by advanced caching tools, when a user agent requests only a small part of a page, and just that section is returned. 
  • 403 - Status Code: The HTTP 403 Forbidden response status code indicates that the server understands the request but refuses to authorize it.
  • 304 - Status Code: The HTTP 304 Not Modified client redirection response code indicates that there is no need to retransmit the requested resources.

GoogleBot Crawl on its own schedule:

So, Googlebot will eventually crawl the post, but likely on its own schedule. Hard to force Google to crawl on demand at times.  We can "Request Indexing” but should only do that once as repeated submissions is not likely going to speed it up. Also, Google will go back anyhow to crawl the post on its own since it knows about this post URL.

Finally, the blog post is indexed in Google on 29 August 2022 - https://scgroup.global/blog/4-essential-security-services/

We did not make any changes in the content, but the blog post load performance is improved with the help of our web developer and then wait for the index.







Comments

Post a Comment

Popular posts from this blog

How I Achieved First Page First Position for High Search Volume Keyword on Google SERP

-
Image
In this post, I would like to share my experience of bringing one of our clients to the first page first position on Google SERP for a high search volume keyword. The client, Pothys, is a big brand in the textile industry with a strong reputation in offline marketing. However, their website was not optimized for basic SEO practices, which I discovered during my initial audit. Pothys was facing a common challenge among businesses - ranking high on Google for a high search volume keyword, "Silk Sarees." When I first analyzed the keyword position, the website was ranking at 7th position on the first page of Google SERP. But Pothys was determined to reach the first position. The search volume of the keyword "Silk Sarees" is (49500/month). I identified several issues with the website that were hindering its search engine ranking. These issues included: Keyword cannibalization : The same keyword "Silk Sarees" was targeted on multiple pages on the site, which was...
Read more

Crawled - Currently Not Indexed

-
Image
 What Google's official document says about "Crawled - currently not indexed": "The page was crawled by Google but not indexed. It may or may not be indexed in the future; no need to resubmit this URL for crawling." Source: https://support.google.com/webmasters/answer/7440203?hl=en Case1: I don't want to index these pages (Category, Tag, Dev & Feed): these pages are already marked as "no-index" in the Meta robots tag.  https://scgroup.global/blog/category/ceo-sleepout/ https://scgroup.global/blog/page/9/ https://scgroup.global/blog/category/technology/electronic-security/ https://scgroup.global/blog/annual-ceremony-awards/a2-1024x768/ ttps://scgroup.global/blog/tag/outstanding-guarding-company/ https://scgroup.global/blog/category/events/ https://scgroup.global/blog/hire-commercial-cleaning-service-provider/feed/ https://scgroup.global/blog/mental-health-in-security-industry/feed/ https://scgroup.global/dev2022/about/advisory-board/ https://sc...
Read more

Crawled - Currently not indexed - My Experience Troubleshooting the Issue

-
Image
 As a SEO Analyst, one of the challenges I faced was encountering a "Crawled - Currently not indexed" status on Google for our old blog post - https://scgroup.global/blog/safety-tip-green-cleaning-cleaner-future/ (Continuity of case 2 ) that I worked on. After some analysis and troubleshooting, I was able to fix the issue and get the post indexed. First , I analyzed the content, meta tags, internal, and external links for the blog post. I used the "Copyscape" tool (https://www.copyscape.com/) to check for any plagiarism issues with the content. I then edited and updated the meta tags to make sure they were properly optimized for the post.  The title and meta description for the post were updated to : Title: Safety Tip: Green Cleaning for a Cleaner Future | Cleaning tips Meta Description: When you choose green cleaning products and practices, your family is safer and healthier. Find out more about the advantages of greener cleaning. The future: green cleaning, clean ...
Read more