Screaming Frog
SEO Spider

The industry leading website crawler for Windows, macOS and Linux, trusted by thousands of SEOs and agencies worldwide for technical SEO site audits.

Windows Windows macOS macOS Linux Linux
Screaming Frog SEO Spider screenshot

SEO Spider Tool

The Screaming Frog SEO Spider is a website crawler that helps you improve onsite SEO by auditing for common SEO issues.

Download & crawl 500 URLs for free. No sign-up required, no time limit. Identifies 300+ SEO issues across technical, on-page, performance and content dimensions.

500
URLs crawlable free
300+
SEO issues identified
10+
years of development
v24.0
latest version

Download Screaming Frog SEO Spider — Versions 19 to 24

Every version is free to download. Crawl and audit up to 500 URLs with no sign-up, no registration and no time limit.

v23.0

Insight Audits & Semantic Rules

  • Lighthouse & PSI updated to Insight Audits
  • Ahrefs v3 API integration
  • Crawl retention auto-delete settings
  • Semantic similarity embedding rules
  • All links displayed in visualizations
  • Links in Semantic Content Cluster Diagram

+ v23.1 (Nov 2025), v23.2 (Dec 2025), v23.3 (Feb 2026)

v22.0

Semantic Analysis & AI Improvements

  • Semantic Similarity Analysis
  • Semantic Content Cluster Visualisation
  • Advanced column configurator
  • Custom multi-export functionality
  • Export to multiple tabs in one workbook
  • Download multiple XML sitemaps
  • Download from Google Sheets · APIs mode
v21.0

Direct AI API Integration

  • AI integration: OpenAI, Google Gemini & Ollama
  • Generate & classify content with AI in-app
  • Accessibility auditing tab
  • Email notifications for completed crawls
  • Custom search bulk upload
v20.0

Custom JS Snippets & Mobile Audits

  • Custom JavaScript Snippets execution
  • Mobile Usability Auditing
  • N-grams content analysis
  • Aggregated Anchor Text reporting
  • Local Lighthouse integration
  • Carbon Footprint & Rating assessment
v19.0

UI Refresh & 3D Visualizations

  • Redesigned UI and updated interface
  • Unified configuration settings panel
  • Segments functionality for filtered analysis
  • Visual Custom Extraction
  • 3D site visualizations
  • New filters and issue categories

Release Timeline — v19 to v24

v24.0 MCP Integration · Auto Compare · Arm64 Linux
v23.3 Bug fixes & stability
v23.2 Bug fixes
v23.1 Bug fixes & stability
v23.0 Insight Audits · Ahrefs v3 · Semantic Rules
v22.0 Semantic Analysis · Content Clusters · APIs Mode
v21.0 AI API Integration · Accessibility · Email Notifications
v20.0 Custom JS Snippets · Mobile Usability · Carbon Footprint
v19.0 UI Refresh · Segments · 3D Visualizations

What can you do with the SEO Spider?

Identify over 300 SEO issues, warnings and opportunities to improve SEO, website health and user experience.

Find Broken Links

Find Broken Links

Crawl a website and find broken links (404s) and server errors. Export source URLs for developer handoff.

Audit Redirects

Audit Redirects

Find temporary and permanent redirects, identify redirect chains and loops, or upload a URL list for migration auditing.

Analyse Metadata

Analyse Page Titles & Meta Data

Identify titles and descriptions that are too long, short, missing or duplicated across your site.

Duplicate Content

Discover Duplicate Content

Find exact duplicate URLs via MD5 hash, partial duplicates in titles and headings, and low content pages.

Custom Extraction

Extract Data with XPath

Collect any data from page HTML using CSS Path, XPath or regex — prices, SKUs, social meta tags and more.

Robots Directives

Review Robots & Directives

View URLs blocked by robots.txt, meta robots or X-Robots-Tag noindex/nofollow, plus canonicals and hreflang.

XML Sitemaps

Generate XML Sitemaps

Quickly create XML and Image XML Sitemaps with full control over URLs, last modified, priority and change frequency.

Google API Integration

Integrate with GA, GSC & PSI

Connect Google Analytics 4, Search Console and PageSpeed Insights APIs to enrich all crawled URLs.

JavaScript Crawling

Crawl JavaScript Websites

Render pages using the built-in Chromium WRS to crawl dynamic sites — Angular, React and Vue.js supported.

Site Architecture

Visualise Site Architecture

Evaluate internal linking with interactive force-directed diagrams, tree graphs and 3D site visualisations.

Schedule Audits

Schedule Audits

Schedule crawls at chosen intervals and auto export to any location including Google Sheets, or run via command line.

Compare Crawls

Compare Crawls & Staging

Track SEO issue progress between crawls and compare staging against production with advanced URL Mapping.

300+ issues across every SEO dimension

Technical

  • Broken links & 404 errors
  • Redirect chains & loops
  • Blocked resources (robots.txt)
  • HTTPS / mixed content
  • Hreflang & internationalisation
  • Pagination (rel=next/prev)

On-Page SEO

  • Page titles & meta descriptions
  • H1, H2 and heading structure
  • Canonical tags & noindex
  • Duplicate & near-duplicate content
  • Thin / low-content pages
  • Structured data & schema.org

Performance & UX

  • Core Web Vitals (PSI/Lighthouse)
  • Mobile usability auditing
  • Carbon footprint & rating
  • AMP validation
  • Accessibility auditing
  • Image optimisation & alt text

Analysis & AI

  • Internal linking & anchor text
  • N-grams content analysis
  • Semantic similarity analysis
  • Content cluster visualisation
  • Crawl comparison & tracking
  • AI content generation (OpenAI/Gemini)

What SEO experts say

★★★★★

"Out of the myriad of tools we use at iPullRank I can definitively say that I only use the Screaming Frog SEO Spider every single day. It's incredibly feature-rich, rapidly improving and I regularly find a new use case."

Mike King
Mike King Founder, iPullRank
★★★★★

"The Screaming Frog SEO Spider is my 'go to' tool for initial SEO audits and quick validations: powerful, flexible and low-cost. I couldn't recommend it more."

Aleyda Solis
Aleyda Solis Owner, Orainti
★★★★★

"I've tested nearly every SEO tool on the market, but I can't think of any I use more often than Screaming Frog. To me, it's the Swiss Army Knife of SEO Tools."

Glenn Gabe
Glenn Gabe Founder, GSQI
★★★★★

"The Screaming Frog SEO Crawler is one of the essential tools I turn to when performing a site audit. It saves time when I want to analyze the structure of a site."

Bill Slawski
Bill Slawski Director, Go Fish Digital
// Deep technical SEO guide · 2026

Screaming Frog SEO Spider: the desktop crawler that exposes deep technical defects

Screaming Frog SEO Spider is the desktop crawler technical SEOs reach for when surface-level audits are not enough. The screaming frog seo spider parses raw HTML and rendered DOM side by side, validates canonicals against indexable status, checks every hreflang return-tag pair for reciprocity, flags mixed-content warnings on HTTPS pages, and surfaces soft-404 patterns that cloud platforms routinely miss. Each crawl produces an inventory of exactly what Googlebot would see, with 300+ distinct issue checks layered over the response.

The free tier covers 500 URLs per session without sign-up, the Pro licence lifts the cap and unlocks JavaScript rendering through a bundled Chromium WRS, and version 24 — released 19 May 2026 — adds Model Context Protocol (MCP) support so the engine can be driven from Claude, Cursor or LM Studio. This guide explains what is screaming frog at the engine level, how seo screaming frog catches the structural problems that block indexation, where screaming frog pricing lands in 2026, and how to use screaming frog to improve on page seo across Mac and Windows installs.

Quick answer: screaming frog free crawls 500 URLs without sign-up and runs the same 300+ technical checks as the paid build — canonicals, hreflang return tags, structured-data validation, mixed-content, soft-404 detection and orphan-page reports all included.

Under the hood

What is Screaming Frog and what the engine actually inspects

What is screaming frog, in technical terms: a desktop crawler that issues real HTTP requests, parses both raw HTML and the rendered DOM, follows canonical chains end-to-end, walks every hreflang cluster looking for missing return tags, validates inline JSON-LD against schema.org and Google rich-result rules, and writes every result to a local database you fully control. Because it runs on your machine — Mac, Windows or Linux — crawl data never leaves your laptop, and the only ceiling is the RAM you allocate.

The screaming frog seo tool surfaces 300+ technical defects per crawl: orphan pages absent from internal linking, soft-404s where the server returns 200 but the body is empty, redirect chains longer than two hops, mixed-content warnings on HTTPS templates, non-self-referencing canonicals, broken hreflang reciprocity, missing alternate links, structured-data validation errors, oversized HTML, slow Time to First Byte and dozens more. Seo screaming frog effectively replaces a sitemap generator, a redirect mapper, a schema validator, a hreflang cluster checker and a log-file analyser in one binary — the on-disk source of truth for what search engines actually see when they render the page.

Version 24 · May 2026

Screaming Frog SEO Spider features built for technical audits

The v24 release on 19 May 2026 sharpened the technical edge that defines the screaming frog seo spider features set. Three additions changed how deep audits get run.

MCP integration

Drive the crawler from Claude, Cursor or LM Studio via Model Context Protocol. Ask the LLM to crawl, diff schema markup, summarise hreflang errors and export the offending URLs — all without touching the UI.

Auto Compare Crawls

Scheduled audits now diff against the previous run automatically. Regression reports land in your inbox with a delta on every technical metric — new canonical conflicts, new orphan pages, new hreflang return-tag errors.

Find Uncrawlable Links

Flags JS-only links the rendering engine cannot follow, plus malformed URLs like hppts://example.com. The spider catches when a Vue.js route returns 200 but renders zero indexable content — a classic soft-404 trap.

Deeper inspection layers: the screaming frog seo tool ships JavaScript rendering through a bundled Chromium WRS for React, Angular, Vue and Next.js sites, raw-vs-rendered DOM diff to spot mobile/desktop rendering gaps, and custom extraction with XPath, CSS Path or regex for pulling any DOM node into its own column.

A built-in structured-data validator verifies JSON-LD, Microdata and RDFa against schema.org and Google rich-result rules, while the companion log file analyser ingests raw server logs to map Googlebot's actual crawl path against your sitemap — the only reliable way to spot crawl-budget waste.

Pricing

Screaming Frog pricing for serious technical audits

Screaming frog pricing is unchanged since 2017 — a flat £199 per year for the Pro licence, free for crawls up to 500 URLs. Both builds run the same 300+ technical checks; the paid tier removes the URL cap and unlocks the integrations a deep technical audit actually needs.

Free forever
£0/yr · no sign-up

Screaming Frog Free

  • Crawl up to 500 URLs per session
  • Full canonical, hreflang & redirect-chain reports
  • Structured-data validation (JSON-LD, Microdata)
  • XML sitemap generator with lastmod control
  • Native Mac, Windows, Linux builds
  • No trial countdown, no expiration
Pro licence
£199/yr · ~$250 USD

Screaming Frog Paid

  • Unlimited URLs per crawl
  • JavaScript rendering via Chromium WRS
  • Custom extraction with XPath, CSS Path, regex
  • GA4, Search Console, PageSpeed, Ahrefs APIs
  • Scheduled crawls with Auto Compare diffs
  • 1 licence covers 2 machines (Mac + Windows)
Cross-platform

Screaming Frog on Mac vs Windows for deep crawls

The screaming frog seo spider ships native binaries for Mac, Windows and Linux. Feature parity is exact across the 300+ technical checks; what differs between platforms is install path, default memory ceiling and how comfortably each can render a million-URL JavaScript site.

Screaming Frog on MacUniversal binary · M1 → Tahoe

The macOS build runs as a notarised universal binary on Ventura (13) through Sequoia (15) and macOS Tahoe (26). Apple Silicon shines on JS-rendered audits — an M3 Pro processes a 100k-URL Next.js crawl in roughly half the wall-clock time of a comparable Intel Core i9, because the bundled Chromium WRS scales linearly with available performance cores.

Memory defaults to 2 GB; for deep technical crawls on enterprise sites raise it under Configuration → System → Memory Allocation. The app installs to /Applications/Screaming Frog SEO Spider.app and stores its database under ~/Library/Application Support/Screaming Frog SEO Spider/.

Screaming Frog on Windows64-bit Win 10 & Win 11

The Windows build targets 10 and 11 (64-bit only). Workstations with 32 GB RAM routinely push the allocation to 16 GB inside Configuration → System → Memory, making Windows the comfortable choice for million-URL crawls where database mode keeps the on-disk index fast.

The installer writes to C:\Program Files (x86)\Screaming Frog SEO Spider\ and the database lives under %APPDATA%\Screaming Frog SEO Spider\. No technical-audit feature is platform-locked — canonicals, hreflang validation, log analysis and schema validation behave identically on Mac and Windows.

vs the alternatives

Screaming Frog vs Ahrefs, SEMrush, SE Ranking, DeepCrawl

The most common comparison searches are screaming frog vs ahrefs, ahrefs vs screaming frog and screaming frog vs semrush — but they are not really competing in the same lane. Most agencies run both a crawler and a research platform side-by-side.

vs Ahrefs
Is ahrefs like screaming frog? No. Ahrefs is a cloud SEO platform built on its own backlink index, keyword database and rank tracker. The Ahrefs Site Audit is the closest comparable feature, but it runs on Ahrefs servers and caps audits by URL quota. Screaming frog has no research component — it crawls only, but does so without quotas.
vs SEMrush
Same lane only at audit level Screaming frog vs semrush — SEMrush's Site Audit competes only on the crawl side; the broader SEMrush platform covers keyword research, competitor analysis and PPC that screaming frog does not touch.
vs SE Ranking
Cheaper cloud platform, not a crawler Se ranking vs screaming frog — SE Ranking is the budget alternative to Ahrefs and Semrush, also cloud-based, also offering a Site Audit that competes with the crawl-only seo screaming frog. The trade-off is the same: cloud limits and quota vs unlimited local crawls.
vs DeepCrawl
Closest in scope, enterprise pricing Screaming frog vs deepcrawl (now Lumar) is the only true head-to-head. DeepCrawl is a cloud enterprise crawler with unlimited URLs, scheduled audits and team workflows. The screaming frog alternative case for DeepCrawl is strongest at the 1M+ URL scale; below that, the desktop tool is faster and cheaper per crawl.
Five-pass audit workflow

How to use Screaming Frog to improve on page SEO

How to use screaming frog to improve on page seo comes down to a five-pass workflow that fits inside a single afternoon for most mid-sized sites.

Start with a JS-rendered crawl

Set Configuration → Spider → Rendering → JavaScript, then crawl the production domain. JS rendering catches dynamic content that plain HTML crawls miss.

Triage the top three issue categories

Open Reports → Crawl Overview. Usually: missing meta descriptions, duplicate titles, broken internal links. Export each list, fix in CMS, re-crawl staging to verify.

Connect Search Console & GA4

Configuration → API Access. Overlay impressions, CTR and traffic on every crawled URL so you prioritise rewrites where they actually move the needle.

Generate & submit XML sitemap

Sitemaps → XML Sitemap. Build from your clean crawl, exclude redirected and 404 URLs, submit to Search Console.

Schedule weekly Auto Compare

Set a weekly scheduled crawl with Auto Compare enabled. New issues surface in your inbox the day they appear — works identically on Mac and Windows.

This is the workflow that turns a 60-minute crawl into a measurable rankings move. Hit the Download button below to grab the latest build for Mac, Windows or Linux.

Download & crawl 500 URLs for free

The industry's most trusted website crawler. No sign-up required. Available for Windows, macOS and Linux.

Free Download — v24.0
Windows macOS Linux

Free · Up to 500 URLs · No sign-up required

Frequently asked questions

Yes. Screaming Frog SEO Spider is completely free to download and use. No sign-up, no registration and no time limit. The tool crawls up to 500 URLs and includes all core SEO audit features out of the box.
Screaming Frog SEO Spider crawls up to 500 URLs per session. This is sufficient for auditing small websites, testing specific site sections, or running targeted technical SEO audits. No payment or sign-up required.
Screaming Frog SEO Spider runs on Windows, macOS and Linux. From version 24, native Arm64 Linux is supported. It is a 64-bit application and a single download covers all three platforms.
Version 24.0 (released May 19, 2026) introduced MCP (Model Context Protocol) integration for AI tools, Auto Compare Crawls, crawl change email notifications with attachment exports, uncrawlable link detection, a usage statistics dashboard, and native Arm64 Linux support.
Yes. Screaming Frog includes a built-in Chromium-based Web Rendering Service (WRS) that crawls JavaScript-rendered sites built with React, Angular, Vue.js, Next.js and other frameworks. JavaScript rendering can be toggled per crawl.
Yes. Screaming Frog integrates with Google Analytics 4, Google Search Console and PageSpeed Insights APIs, enriching crawl data with traffic, impressions, click-through rates and Core Web Vitals for every crawled URL.