Source
Product page — Screaming Frog SEO Spider
Checked for Screaming Frog SEO Spider on 16 Sep 2026
- Page
- https://www.screamingfrog.co.uk/seo-spider/
- Checked
- 16 Sep 2026, 03:42 UTC
- How we may use it
- Public page, crawling permitted
Technical details
- type
- page
- http status
- 200
- content hash
- sha256:bd20c78c9b1ba43f2620a2b70b9ec5ee45d45890f785a562761382e7721d403d
- permission
- robots_ok
- screenshot
- Screenshot on file (internal exhibit, not published)
Cited by
Facts read from this source
-
Platforms Report an error
“The industry leading website crawler for Windows, macOS and Linux”
-
Audit issue count Report an error
“audits your site for over 300 SEO issues to help improve both SEO, and UX.”
-
Free tier Report an error
“Download & crawl 500 URLs for free”
-
Paid price usd Report an error
“buy a licence for $279 Per Year to remove the limit & access advanced features.”
-
Paid price gbp Report an error
“For just £199 per year you can purchase a licence, which removes the 500 URL crawl limit, allows you to save crawls, and opens up the spider’s configuration options and advanced features.”
-
Licence term Report an error
“Licences last 1 year. After that you will be required to renew your licence.”
-
Free version restrictions Report an error
“The free version is restricted to crawling up to 500 URLs in a single crawl. The crawl configuration, saving of crawls, and advanced features such as JavaScript rendering, custom extraction, and API integrations are also restricted.”
-
Free no signup Report an error
“The ‘lite’ version of the tool is free to download and use – without any sign up or email capture.”
-
Broken links Report an error
“Crawl a website instantly and find broken links (404s) and server errors. Bulk export the errors and source URLs to fix, or send to a developer.”
-
Redirect audit Report an error
“Find temporary and permanent redirects, identify redirect chains and loops, or upload a list of URLs to audit in a site migration.”
-
Meta data analysis Report an error
“Analyse page titles and meta descriptions during a crawl and identify those that are too long, short, missing, or duplicated across your site.”
-
Duplicate content Report an error
“Discover exact duplicate URLs with an md5 algorithmic check, partially duplicated elements such as page titles, descriptions or headings and find low content pages.”
-
Custom extraction Report an error
“Collect any data from the HTML of a web page using CSS Path, XPath or regex.”
-
Robots directives Report an error
“View URLs blocked by robots.txt, meta robots or X-Robots-Tag directives such as ‘noindex’ or ‘nofollow’, as well as canonicals and rel=“next” and rel=“prev”.”
-
Xml sitemap generation Report an error
“Quickly create XML Sitemaps and Image XML Sitemaps, with advanced configuration over URLs to include, last modified, priority and change frequency.”
-
API integrations Report an error
“Connect to the Google Analytics, Search Console and PageSpeed Insights APIs and fetch user and performance data for all URLs in a crawl for greater insight.”
-
Javascript rendering Report an error
“Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.”
-
Site visualisations Report an error
“Evaluate internal linking and URL structure using interactive crawl and directory force-directed diagrams and tree graph site visualisations.”
-
Scheduling Report an error
“Schedule crawls to run at chosen intervals and auto export crawl data to any location, including Google Sheets. Or automate entirely via command line.”
-
Crawl comparison Report an error
“Track progress of SEO issues and opportunities and see what's changed between crawls. Compare staging against production environments using advanced URL Mapping.”
-
Link metrics integration Report an error
“Pull external link metrics from Majestic, Ahrefs and Moz APIs into a crawl to perform content audits or profile links.”
-
AI integration Report an error
“Set up custom AI prompts with OpenAI, Gemini, Ollama and Anthropic while crawling for insight.”
-
Accessibility auditing Report an error
“Use the open-source AXE accessibility rule set for automated accessibility validation to test against Web Content Accessibility Guidelines (WCAG).”
-
Structured data validation Report an error
“Extract & validate structured data against Schema.org specifications and Google rich result features.”
-
Spelling grammar Report an error
“Spell & grammar check your website in over 25 different languages.”
-
User agent Report an error
“Crawl as a search bot such as Googlebot or Bingbot, AI crawlers, or your own custom UA.”
-
Authentication Report an error
“Forms Based Authentication”
-
Segmentation Report an error
“Segmentation”
-
Looker studio reports Report an error
“Set up automated Data Studio crawl reports to monitor site health and trends.”
-
Custom javascript Report an error
“Run custom JavaScript snippets while crawling, to extract data, trigger mouseover events, scroll a page or nearly anything else you’re able to do in the Chrome console.”
-
Amp crawling Report an error
“Crawl AMP URLs and validate them, using the official integrated AMP Validator.”
-
Xml sitemap analysis Report an error
“Crawl an XML Sitemap independently or part of a crawl, to find missing, non-indexable and orphan pages.”
-
Mobile usability Report an error
“Use Lighthouse to check for common mobile usability issues.”
-
Hreflang audit Report an error
“Audit missing return tags, inconsistent & incorrect languages codes, non-200 response hreflang and more.”
-
Screenshots Report an error
“Rendered Screen Shots – Fetch, view and analyse the rendered pages crawled.”
-
Custom robots txt Report an error
“Download, edit and test a site’s robots.txt using the new custom robots.txt.”
-
Storage engine Report an error
“It uses a configurable hybrid storage engine, able to save data to disk to crawl large websites.”
-
Issue explanations Report an error
“An in-app explanation of each issue and potential actions is provided. Each issue has a ‘type’ and an estimated ‘priority’ based upon the potential impact.”
-
Export Report an error
“The SEO Spider allows you to export key onsite SEO elements (URL, page title, meta description, headings etc) to a spread sheet, so it can easily be used as a base for SEO recommendations.”
-
Free technical support Report an error
“Free Technical Support”
-
Entity Report an error
“Screaming Frog Ltd 6 Greys Road, Henley-on-Thames, Oxfordshire, RG9 1RY. UK”
-
Company registration Report an error
“Company no. 07277243 / VAT no. 995 3157 78”
-
Trial after download Report an error
“Alternatively hit the ‘buy a licence’ button in the SEO Spider to buy a licence after trialing the software.”
1 fact read from this page is not shown because it could not be confirmed on the page as captured.
Scores citing this record
- The Agency Owner Crawling & technical audit
- The Agency Owner Keyword research & content guidance
- The Agency Owner Rank tracking & index quality
- The Agency Owner Reporting, integrations & API
- The Agency Owner Data portability & exit
- The Agency Owner Pricing transparency
- The Content Strategist Crawling & technical audit
- The Content Strategist Keyword research & content guidance
- The Content Strategist Rank tracking & index quality
- The Content Strategist Reporting, integrations & API
- The Content Strategist Data portability & exit
- The Content Strategist European sovereignty
- The Content Strategist Pricing transparency
- The Data Analyst Crawling & technical audit
- The Data Analyst Keyword research & content guidance
- The Data Analyst Rank tracking & index quality
- The Data Analyst Reporting, integrations & API
- The Data Analyst Data portability & exit
- The Data Analyst European sovereignty
- The Data Analyst Pricing transparency
- The In-House SEO Lead Crawling & technical audit
- The In-House SEO Lead Keyword research & content guidance
- The In-House SEO Lead Rank tracking & index quality
- The In-House SEO Lead Reporting, integrations & API
- The In-House SEO Lead Data portability & exit
- The In-House SEO Lead European sovereignty
- The In-House SEO Lead Pricing transparency
- The Skeptic Crawling & technical audit
- The Skeptic Keyword research & content guidance
- The Skeptic Rank tracking & index quality
- The Skeptic Reporting, integrations & API
- The Skeptic Data portability & exit
- The Skeptic Pricing transparency
- The Technical SEO Crawling & technical audit
- The Technical SEO Keyword research & content guidance
- The Technical SEO Rank tracking & index quality
- The Technical SEO Reporting, integrations & API
- The Technical SEO Data portability & exit
- The Technical SEO Pricing transparency