Source
Product page — Screaming Frog SEO Spider
Checked for Screaming Frog SEO Spider on 2 Nov 2026
- Page
- https://www.screamingfrog.co.uk/seo-spider/
- Checked
- 2 Nov 2026, 10:50 UTC
- How we may use it
- Public page, crawling permitted
Technical details
- type
- page
- http status
- 200
- content hash
- sha256:87ba7d490bbba10e85fdeadd98dbf3c1b633822a83f758ae594f514eb3495412
- permission
- robots_ok
- screenshot
- Screenshot on file (internal exhibit, not published)
Cited by
Facts read from this source
-
Platforms Report an error
“The industry leading website crawler for Windows, macOS and Linux”
-
Issue count Report an error
“audits your site for over 300 SEO issues”
-
Free tier Report an error
“Free Version 500 URLs Free Download free version”
-
Paid price Report an error
“Unlimited* £ 199 Per Year Purchase licence”
-
Licence duration Report an error
“Licences last 1 year. After that you will be required to renew your licence.”
-
Unlimited caveat Report an error
“* The maximum number of URLs you can crawl is dependent on allocated memory and storage.”
-
Free no signup Report an error
“The ‘lite’ version of the tool is free to download and use – without any sign up or email capture.”
-
Free restrictions Report an error
“The crawl configuration, saving of crawls, and advanced features such as JavaScript rendering, custom extraction, and API integrations are also restricted.”
-
Paid removes limit Report an error
“For just £199 per year you can purchase a licence, which removes the 500 URL crawl limit, allows you to save crawls, and opens up the spider’s configuration options and advanced features.”
-
Broken links Report an error
“Crawl a website instantly and find broken links (404s) and server errors.”
-
Redirect audit Report an error
“Find temporary and permanent redirects, identify redirect chains and loops, or upload a list of URLs to audit in a site migration.”
-
Meta data analysis Report an error
“Analyse page titles and meta descriptions during a crawl and identify those that are too long, short, missing, or duplicated across your site.”
-
Duplicate content Report an error
“Discover exact duplicate URLs with an md5 algorithmic check, partially duplicated elements such as page titles, descriptions or headings and find low content pages.”
-
Custom extraction Report an error
“Collect any data from the HTML of a web page using CSS Path, XPath or regex.”
-
Robots directives Report an error
“View URLs blocked by robots.txt, meta robots or X-Robots-Tag directives such as ‘noindex’ or ‘nofollow’, as well as canonicals and rel=“next” and rel=“prev”.”
-
Xml sitemaps Report an error
“Quickly create XML Sitemaps and Image XML Sitemaps, with advanced configuration over URLs to include, last modified, priority and change frequency.”
-
Google APIs Report an error
“Connect to the Google Analytics, Search Console and PageSpeed Insights APIs and fetch user and performance data for all URLs in a crawl for greater insight.”
-
Javascript rendering Report an error
“Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.”
-
Visualisations Report an error
“Evaluate internal linking and URL structure using interactive crawl and directory force-directed diagrams and tree graph site visualisations.”
-
Scheduling Report an error
“Schedule crawls to run at chosen intervals and auto export crawl data to any location, including Google Sheets. Or automate entirely via command line.”
-
Crawl comparison Report an error
“Track progress of SEO issues and opportunities and see what's changed between crawls. Compare staging against production environments using advanced URL Mapping.”
-
Feature list Report an error
“Features Find Broken Links, Errors & Redirects Analyse Page Titles & Meta Data Review Meta Robots & Directives Audit hreflang Attributes Discover Exact Duplicate Pages Generate XML Sitemaps Site Visualisations Crawl Limit Scheduling Crawl Configuration Save & Open Crawls JavaScript Rendering Crawl Comparison Near Duplicate Content Custom robots.txt Mobile Usability AMP Crawling & Validation Structured Data & Validation Spelling & Grammar Checks Custom Source Code Search Custom Extraction Custom JavaScript Crawl with OpenAI & Gemini Google Analytics Integration Search Console Integration PageSpeed Insights Integration Accessibility Auditing Link Metrics Integration Forms Based Authentication Segmentation Looker Studio Crawl Report Free Technical Support”
-
Link metrics Report an error
“Pull external link metrics from Majestic, Ahrefs and Moz APIs into a crawl to perform content audits or profile links.”
-
AI integration Report an error
“Set up custom AI prompts with OpenAI, Gemini, Ollama and Anthropic while crawling for insight.”
-
Accessibility Report an error
“Use the open-source AXE accessibility rule set for automated accessibility validation to test against Web Content Accessibility Guidelines (WCAG).”
-
Spelling Report an error
“Spell & grammar check your website in over 25 different languages.”
-
User agent Report an error
“Crawl as a search bot such as Googlebot or Bingbot, AI crawlers, or your own custom UA.”
-
Authentication Report an error
“Forms Based Authentication”
-
Segmentation Report an error
“Segmentation”
-
Looker studio reports Report an error
“Looker Studio Crawl Report”
-
Storage engine Report an error
“It uses a configurable hybrid storage engine, able to save data to disk to crawl large websites.”
-
Crawl algorithm Report an error
“The SEO Spider crawls sites like Googlebot discovering hyperlinks in the HTML using a breadth-first algorithm.”
-
Issue explanations Report an error
“An in-app explanation of each issue and potential actions is provided. Each issue has a ‘type’ and an estimated ‘priority’ based upon the potential impact.”
-
Export Report an error
“The SEO Spider allows you to export key onsite SEO elements (URL, page title, meta description, headings etc) to a spread sheet”
-
Channel Report an error
“If you have any technical problems, feedback or feature requests for the SEO Spider, then please just contact us via our support.”
-
Free technical support Report an error
“Free Technical Support”
-
Entity Report an error
“Screaming Frog Ltd 6 Greys Road, Henley-on-Thames, Oxfordshire, RG9 1RY. UK”
-
Company number Report an error
“Company no. 07277243 / VAT no. 995 3157 78”
-
Structured data Report an error
“Extract & validate structured data against Schema.org specifications and Google rich result features.”
-
Amp Report an error
“Crawl AMP URLs and validate them, using the official integrated AMP Validator.”
-
Sitemap analysis Report an error
“Crawl an XML Sitemap independently or part of a crawl, to find missing, non-indexable and orphan pages.”
-
Custom javascript Report an error
“Run custom JavaScript snippets while crawling, to extract data, trigger mouseover events, scroll a page or nearly anything else you’re able to do in the Chrome console.”
-
Trial path Report an error
“Alternatively hit the ‘buy a licence’ button in the SEO Spider to buy a licence after trialing the software.”
Scores citing this record
- The Agency Owner Crawling & technical audit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Rank tracking & index quality
- The Agency Owner Reporting, integrations & API
- The Agency Owner Data portability & exit
- The Agency Owner European sovereignty
- The Agency Owner Pricing transparency
- The Agency Owner Crawling & technical audit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Rank tracking & index quality
- The Agency Owner Reporting, integrations & API
- The Agency Owner Data portability & exit
- The Agency Owner Pricing transparency
- The Agency Owner Crawling & technical audit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Rank tracking & index quality
- The Agency Owner Reporting, integrations & API
- The Agency Owner Pricing transparency
- The Agency Owner Crawling & technical audit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Rank tracking & index quality
- The Agency Owner Reporting, integrations & API
- The Agency Owner Data portability & exit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Crawling & technical audit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Rank tracking & index quality
- The Content Strategist Crawling & technical audit
- The Content Strategist Keyword research & content guidance
- The Content Strategist Rank tracking & index quality
- The Content Strategist Reporting, integrations & API
- The Content Strategist Data portability & exit
- The Content Strategist Pricing transparency
- The Content Strategist Crawling & technical audit
- The Content Strategist Keyword research & content guidance
- The Content Strategist Rank tracking & index quality
- The Content Strategist Reporting, integrations & API
- The Content Strategist Data portability & exit
- The Content Strategist Crawling & technical audit
- The Content Strategist Keyword research & content guidance
- The Content Strategist Rank tracking & index quality
- The Content Strategist Reporting, integrations & API
- The Content Strategist Data portability & exit
- The Content Strategist Pricing transparency
- The Content Strategist Crawling & technical audit
- The Content Strategist Keyword research & content guidance
- The Content Strategist Rank tracking & index quality
- The Content Strategist Reporting, integrations & API
- The Content Strategist Data portability & exit
- The Content Strategist Pricing transparency
- The Content Strategist Keyword research & content guidance
- The Content Strategist Rank tracking & index quality
- The Content Strategist Keyword research & content guidance
- The Data Analyst Crawling & technical audit
- The Data Analyst Keyword research & content guidance
- The Data Analyst Rank tracking & index quality
- The Data Analyst Reporting, integrations & API
- The Data Analyst Data portability & exit
- The Data Analyst Pricing transparency
- The Data Analyst Crawling & technical audit
- The Data Analyst Keyword research & content guidance
- The Data Analyst Reporting, integrations & API
- The Data Analyst Data portability & exit
- The Data Analyst Pricing transparency
- The Data Analyst Crawling & technical audit
- The Data Analyst Keyword research & content guidance
- The Data Analyst Rank tracking & index quality
- The Data Analyst Reporting, integrations & API
- The Data Analyst Pricing transparency
- The Data Analyst Crawling & technical audit
- The Data Analyst Keyword research & content guidance
- The Data Analyst Rank tracking & index quality
- The Data Analyst Reporting, integrations & API
- The Data Analyst Pricing transparency
- The Data Analyst Keyword research & content guidance
- The Data Analyst Rank tracking & index quality
- The Data Analyst Keyword research & content guidance
- The Data Analyst Rank tracking & index quality
- The In-House SEO Lead Crawling & technical audit
- The In-House SEO Lead Keyword research & content guidance
- The In-House SEO Lead Rank tracking & index quality
- The In-House SEO Lead Reporting, integrations & API
- The In-House SEO Lead Data portability & exit
- The In-House SEO Lead European sovereignty
- The In-House SEO Lead Pricing transparency
- The In-House SEO Lead Crawling & technical audit
- The In-House SEO Lead Keyword research & content guidance
- The In-House SEO Lead Rank tracking & index quality
- The In-House SEO Lead Reporting, integrations & API
- The In-House SEO Lead Data portability & exit
- The In-House SEO Lead Crawling & technical audit
- The In-House SEO Lead Keyword research & content guidance
- The In-House SEO Lead Rank tracking & index quality
- The In-House SEO Lead Reporting, integrations & API
- The In-House SEO Lead Data portability & exit
- The In-House SEO Lead Pricing transparency
- The In-House SEO Lead Crawling & technical audit
- The In-House SEO Lead Keyword research & content guidance
- The In-House SEO Lead Rank tracking & index quality
- The In-House SEO Lead Reporting, integrations & API
- The In-House SEO Lead Data portability & exit
- The In-House SEO Lead Pricing transparency
- The In-House SEO Lead Crawling & technical audit
- The Skeptic Crawling & technical audit
- The Skeptic Keyword research & content guidance
- The Skeptic Rank tracking & index quality
- The Skeptic Reporting, integrations & API
- The Skeptic Data portability & exit
- The Skeptic European sovereignty
- The Skeptic Pricing transparency
- The Skeptic Crawling & technical audit
- The Skeptic Keyword research & content guidance
- The Skeptic Reporting, integrations & API
- The Skeptic Crawling & technical audit
- The Skeptic Keyword research & content guidance
- The Skeptic Rank tracking & index quality
- The Skeptic Reporting, integrations & API
- The Skeptic Data portability & exit
- The Skeptic Pricing transparency
- The Skeptic Crawling & technical audit
- The Skeptic Keyword research & content guidance
- The Skeptic Rank tracking & index quality
- The Skeptic Reporting, integrations & API
- The Skeptic Data portability & exit
- The Skeptic Pricing transparency
- The Skeptic Keyword research & content guidance
- The Skeptic Rank tracking & index quality
- The Skeptic Data portability & exit
- The Technical SEO Crawling & technical audit
- The Technical SEO Keyword research & content guidance
- The Technical SEO Rank tracking & index quality
- The Technical SEO Reporting, integrations & API
- The Technical SEO Data portability & exit
- The Technical SEO Pricing transparency
- The Technical SEO Crawling & technical audit
- The Technical SEO Keyword research & content guidance
- The Technical SEO Rank tracking & index quality
- The Technical SEO Reporting, integrations & API
- The Technical SEO Crawling & technical audit
- The Technical SEO Keyword research & content guidance
- The Technical SEO Rank tracking & index quality
- The Technical SEO Reporting, integrations & API
- The Technical SEO Data portability & exit
- The Technical SEO Pricing transparency
- The Technical SEO Crawling & technical audit
- The Technical SEO Keyword research & content guidance
- The Technical SEO Rank tracking & index quality
- The Technical SEO Reporting, integrations & API
- The Technical SEO Data portability & exit
- The Technical SEO Pricing transparency
- The Technical SEO Crawling & technical audit
- The Technical SEO Keyword research & content guidance
- The Technical SEO Rank tracking & index quality