Screaming Frog
The British desktop crawler that every technical SEO already owns, running entirely on your own machine with no data uploaded anywhere
Quick Overview
| Company | Screaming Frog Ltd |
|---|---|
| Category | SEO Tools |
| Headquarters | Henley-on-Thames, United Kingdom |
| Founded | 2010 |
| EU Presence | Yes - United Kingdom |
| Data Location | Your own computer |
| Open Source | No |
| GDPR Compliant | Yes - crawl data stays local |
| Self-Hosting | Yes - it is desktop software |
| Main Features | Site crawling, broken link detection, redirect audits, duplicate content, XML sitemaps, JavaScript rendering, log file analyser, API integrations |
| Pricing | Free for up to 500 URLs / GBP 199 per year for unlimited |
| Best For | Technical SEO audits on any site, from a small business to an enterprise estate |
| Replaces | Semrush Site Audit, Ahrefs Site Audit, Sitebulb |
Detailed Review
Screaming Frog is the closest thing SEO has to a standard tool. It is a desktop crawler from a small agency in Henley-on-Thames that has become the default way technical SEOs audit a site — and because it runs locally, the crawl data never reaches a third party.
That local execution is easy to overlook but genuinely useful: crawling a client's staging environment, an intranet or a site behind authentication involves no upload to a cloud vendor at all.
What It Finds
Broken links, redirect chains and loops, duplicate titles and descriptions, missing canonical tags, orphan pages, oversized images, hreflang errors, thin content and blocked resources — the full technical audit surface, in a spreadsheet-style interface built for filtering and export.
JavaScript rendering handles single-page applications properly, which matters increasingly as more sites render client-side.
Integrations That Multiply Its Value
Connecting Google Analytics, Search Console and PageSpeed Insights joins crawl data to real traffic and performance data per URL. That combination — this page has no internal links, gets no impressions and loads slowly — is what turns a crawl into a prioritised action list.
The separate Log File Analyser reveals how search engines actually crawl a site, which is often quite different from what you assume.
Cost
GBP 199 per year for unlimited crawling, with a free tier up to 500 URLs. Against the equivalent module in an American SEO suite, that is a rounding error, and it is why the tool appears in essentially every agency's stack regardless of what else they use.
Limitations to Consider
Screaming Frog only crawls your site — it has no keyword research, rank tracking, backlink index or competitor analysis, so it is one component of a stack rather than a suite. Large crawls consume substantial memory and require configuration and a well-specified machine. The interface is dense and unwelcoming to beginners.
Who Should Use Screaming Frog
Anyone doing technical SEO, from freelancers to enterprise teams. Paired with Sistrix or Mangools for visibility and keyword work, it forms a complete European alternative to Semrush.
Pros and Cons
Pros
- Runs locally, no data uploaded anywhere
- The de facto standard for technical audits
- GBP 199/year for unlimited crawling
- JavaScript rendering and API integrations
- Free tier up to 500 URLs
Cons
- No keyword, rank or backlink features
- Large crawls need a well-specified machine
- Dense interface with a real learning curve
Alternatives to Screaming Frog
Other European seo tools worth comparing before you decide:
Sistrix
Germany · The Visibility Index and the deepest European SERP history
Mangools
Slovakia · Five focused SEO tools with the best UX in the category
Ryte
Germany · Technical SEO, content quality and website monitoring
OnCrawl
France · Log-file analysis and crawl data for enterprise SEO
See all European seo tools or compare them directly against Semrush Site Audit on our alternatives page.
Frequently Asked Questions
No. It is desktop software and the crawl runs on your own machine, so the data stays there. That makes it usable on staging sites, intranets and authenticated areas without involving a vendor.
Only for the technical audit part. It has no keyword research, rank tracking or backlink index. Pair it with Sistrix or Mangools to cover the rest.
For small sites, yes — it crawls up to 500 URLs with most features. Beyond that, and for API integrations and scheduling, you need the GBP 199 annual licence.
Yes, it has a JavaScript rendering mode that crawls client-rendered applications properly, which is essential for modern single-page sites.