Screaming Frog - the best SEO website crawler there is.
August 21, 2017

Screaming Frog - the best SEO website crawler there is.

Jake Pittman | TrustRadius Reviewer
Score 10 out of 10
Vetted Review
Verified User

Overall Satisfaction with Screaming Frog SEO Spider

Screaming Frog is peerless among SEO tools. The SEO individuals at Clicky use it for a range of different reasons, however, it is used by other people within the marketing team when necessary.

Screaming Frog is really the only tool that pulls out all relevant SEO-related information of a website. If we need all the page titles for each URL on a domain, or if we simply want all the URLs on a domain, we use Screaming Frog. We wouldn't be able to do our jobs without it.
  • Very quick at crawling a website.
  • Pulls out comprehensive information for each URL.
  • Able to export information to CSV files and others.
  • Screaming Frog needs to have a function allowing the user to pull out ALL information, not just sections such as inlinks, outlinks etc.
  • Users should be able to filter non-HTML pages with the click of a button, as opposed to having to manually exclude them.
  • Visually, it could be improved.
  • ROI is hard to quantify, as it is so far removed from any returns we or our clients make. However, we would not be able to perform SEO half as well if we did not have access to Screaming Frog.
There are no tools which can do the things Screaming Frog does. In this sense, it has no competitors. SEMRush and Moz are more SEO management tools as opposed to web crawlers. They both have the capabilities to crawl websites and report on technical information, however, they both fail to do it as quickly and well as Screaming Frog does. Screaming Frog can also be used on demand, which SEMRush and Moz fail to do.
Screaming Frog is suitable when one needs to crawl a website and find page titles, meta information, directives for thousands of pages very quickly. Screaming Frog also pulls information such as broken links and 404 pages. As all of the information is displayed as tables, Screaming Frog is perhaps unsuitable for client-facing documents, audits, and reports.

Screaming Frog Feature Ratings

6.8
Keyword analysis
8
Backlink management
5
Page grader
7
Competitive analysis
4
Site audit / diagnostics
10
Global SEO
10
Multi-domain support
10
Integration with web analytics tools
7