Source
Rank tracking & index quality — found from sitemap — Ahrefs
Checked for Ahrefs on 5 Oct 2026
- Page
- https://help.ahrefs.com/en/articles/1608544-why-doesn-t-ahrefs-crawl-or-index-my-website-fully
- Checked
- 5 Oct 2026, 03:06 UTC
- How we may use it
- Public page, crawling permitted
Technical details
- type
- page
- http status
- 200
- content hash
- sha256:07ad2c492f533fb461abfedbd36c2ebb1064350e246b918eb349c7f8cd89141f
- permission
- robots_ok
- screenshot
- Screenshot on file (internal exhibit, not published)
Cited by
Facts read from this source
-
Ahrefsbot Report an error
“Ahrefs runs our own web crawler, or bot known as AhrefsBot.”
-
Crawl priority factor Report an error
“Crawl priority: in general, the more “popular” a site is (ie. a higher Domain rating (DR), has more quality referring domains), the more likely a domain will be crawled.”
-
Crawl speed factor Report an error
“Speed of crawling/updating: this depends on a page's URL Rating (UR). Pages with a high UR are more likely to be indexed and are updated more often than pages with a low UR.”
-
Page inspect uncrawled message Report an error
“When our bots have yet to crawl the target site, you'll see the following message when checking the Page inspect report: No HTML code snapshot found for this page.”
-
Uncrawled page data unavailable Report an error
“Since the target page has not been crawled yet, on-page data such as the Title, Page content, HTML source code etc are not available in our database. Similarly, any outgoing links from this page would also not be captured.”
-
New domain crawl time Report an error
“If the domain is new, please give our crawler some time to pick up the new website (1-2 weeks is generally a good bet.). Same goes for a new page that has just been created.”
-
Backlinks report third party Report an error
“Note: Backlinks reports will be available if we crawled other sites that have backlinks to the target site.”
-
Blocking check tool Report an error
“It's also possible that the domain might be blocking us from crawling it. To find out if the website's settings is blocking our crawler, enter the URL into our crawler's page: https://ahrefs.com/robot”
Scores citing this record
- The Agency Owner Rank tracking & index quality
- The Content Strategist Rank tracking & index quality
- The Data Analyst Rank tracking & index quality
- The In-House SEO Lead Rank tracking & index quality
- The Skeptic Crawling & technical audit
- The Skeptic Rank tracking & index quality
- The Technical SEO Rank tracking & index quality