The perfect tool to begin a technical analysis of any website
July 10, 2023

The perfect tool to begin a technical analysis of any website

Chris Coultas | TrustRadius Reviewer
Score 10 out of 10
Vetted Review
Verified User

Overall Satisfaction with Screaming Frog SEO Spider

Screaming Frog simulates Google's crawling of a website, allowing us to see how search engines view our website. This includes what pages it can see, whether all the features of a pages are being considered and any pages that experience technical issues that would effect Googles view of those pages.
We use this to gather intelligence of our websites pages, ensuring that we can quickly see if anything is missing from Google's point of view, or anything isn't working. It also allows us to see quickly whether changes made on our Content Management System have actually taken place and are being detected by Google. With this in mind we can also quickly see all of the websites meta data, this is used to tell Google what a page is used for. So rounding all of this up quickly, in one place can quickly indicate whether any of this is out of date.
The tool is best used for SEO purposes, and while some of the technical information is useful for general website maintenance its most useful when concerned with how Google views a website and what technical issue might prevent is ranking better in search results. So it is a narrow use case in the grand scheme of website use, but very useful within its niche.


  • Screaming Frog is an excellent website crawler, creating accurate, up to date, assessments of all a websites pages
  • Screaming Frog is also a fantastic tool for looking at a websites architecture, so you can see which pages are taking priority and are the most well linked around the website.
  • Screaming Frog is also useful for creating an XML sitemap that can be submitted to Google to help highlight key URLs
  • Screaming Frog is a software based tool (rather than all online like a lot of competitors) so it does take up memory on your computer, an online alternative would be very useful
  • When crawling bigger websites, the stability of crawls is less assured and they need to be crawled slowly to accurately retrieve all data. This can make it time consuming to review big websites.
  • Its a very technical tool and the interface and metrics referenced are not easy to understand at first. As such some indications in the tool itself of what each function does would be useful
  • Screaming Frog is a great price for the investment, at a cheap cost per year it factors into any website a marketing agency provides SEO for and is almost part of standard practice when first approaching a new client. As such its invaluable
  • Screaming Frog also provides technical information on a websites technical faults, without fixing more serious technical issues, a website will have limited improvement and growth in making money through organic traffic. As such a tool like Screaming Frog is needed to begin improvement of any website. So it can provide the backbone of any improvement and revenue that might come from that.
  • Overall its a huge time saver allowing for more efficient SEO processes and freeing up time for other work.
The biggest difference between DeepCrawl and Screaming Frog is cost. Screaming Frog is significantly cheaper, and fits within a budget much easier. For most websites that aren't huge it crawls quicker to. DeepCrawl is the better tool for analysing larger websites and is easier to use in some ways, with a very friendly interface and some extras features that are useful. Ultimately price was the deciding factor though.

Do you think Screaming Frog SEO Spider delivers good value for the price?

Yes

Are you happy with Screaming Frog SEO Spider's feature set?

Yes

Did Screaming Frog SEO Spider live up to sales and marketing promises?

Yes

Did implementation of Screaming Frog SEO Spider go as expected?

Yes

Would you buy Screaming Frog SEO Spider again?

Yes

Screaming Frog SEO Spider is well suited to auditing brand new websites, when you need a quick, holistic view of the websites technical issues. Its great for providing a top line view of a websites architecture, perhaps for a new business approach where you need to assess the scale of work to maintain a website. Its also a useful tool in situations where you might need to see whether a large scale change in the website has taken place, you can see word counts, pages and their https response codes. Screaming Frog may be less useful if you need an idea of the customer experience on a website, it doesn't really provide information that helps assess how fast a website loads, what issues might come up when trying to convert or faults with the payment process. Screaming Frog is largely a technical SEO focused tool, it also can't assess the quality of a websites, layout or the quality of the content used on the website. As mentioned, its niche, but very useful within that niche.

Screaming Frog Feature Ratings

8.7
Competitive analysis
6
Site audit / diagnostics
10
Site recommendations
10
Mobile SEO
10
Multi-domain support
10
Integration with web analytics tools
10