Simple and powerful crawler for websites
Updated June 20, 2019

Simple and powerful crawler for websites

Roman Yarovyi | TrustRadius Reviewer
Score 7 out of 10
Vetted Review
Verified User

Overall Satisfaction with Screaming Frog SEO Spider

We are a small company that focuses on digital marketing and SEO service for our clients. Screaming Frog SEO Spider is a great tool to check out what internal structure a client website has. It works like Google robot and scans a website for links and makes list of website pages. After a full scan, you get a report about the basic info of these pages (meta tags, different kinds of errors) and you can create a sitemap with pages and images.
  • You receive a report with internal structure of the website (Pages with status codes, depth structure)
  • List of the pages with incorrect meta tags: meta titles & descriptions, also H1 tags
  • List of the pages with insecure content and links to this content
  • List with 404 errors and response codes
  • List with pages where there is Google Analytics ID mismatch
  • Can create sitemap with pages and images
  • You can't pay per projects, only a subscription is available
  • You need a lot of RAM for big websites (more then 10 millions pages)
  • No cloud version
  • We speed up the process of analyzing a client's website
  • We create an internal structure map of the website with just one click
  • Reports with different errors help make quick fixes
We tried also Netpeak Spider. Good alternative to Screaming Frog. Right now we are comparing these two because Spider can do almost everything that Screaming Frog does. A huge plus for Screaming Spider is that it's very stable; we work with very big projects with it (10-20 millions of pages). Netpeak Spider was not stable enough.
It's a good tool to check out the internal structure of client's website, create a tree with pages. You can check out a website like Google robot and understand which pages can be visited and what content can be submitted to Google. Also, this utility will create reports with different errors, like 404 pages, incorrect meta tags like long meta titles and descriptions, and missing H1 tags. And you can create sitemaps with pages and images if you need.

Screaming Frog Feature Ratings

9.0
Site audit / diagnostics
9