Crawling & technical audit
How this is scored
Site crawling at real scale: what the crawler finds, how deeply it checks, whether Core Web Vitals and indexation problems are diagnosed rather than merely listed.
0 — No site crawler or audit; the product is keyword, rank or backlink data only.
3 — A site audit that crawls pages and reports broken links, missing tags and redirect problems.
5 — Scheduled site audits with a stated page limit, issues grouped by category and severity with fix hints, and page speed or Core Web Vitals reported.
8 — JavaScript rendering, log-file or Search Console integration to compare what the crawler sees against what Google fetched, indexation and canonical diagnosis, structured-data validation, crawl comparison over time, and issues prioritised by traffic impact rather than count.
10 — The audit is diagnostic rather than a list: crawl budget analysed, rendering differences surfaced, regressions detected between crawls with the deploy that caused them inferrable, and remediation guidance specific enough for a developer ticket.
The Skeptic
Site Audit is a genuinely configurable crawler — JavaScript execution toggle, robots.txt override with a mobile user agent, HTTP-auth crawling on Advanced and up, scheduling by day and timezone, speed up to 30,000 URLs per minute, and crawl credits stated per plan — plus PageSpeed scoring, though that runs on the customer's own Google API key. What I cannot hold to is the diagnostic layer: we found no public information on severity grouping with fix hints, indexation or canonical diagnosis, structured-data validation, or crawl comparison over time. Score 5. 4 12 2 2