TrustRadius Insights
Screaming Frog SEO Spider is a versatile tool that has become indispensable for various user needs. Users appreciate its effectiveness in …
Starting at $149 per year
View PricingOverview
Recent Reviews
Awards
Products that are considered exceptional by their customers based on a variety of criteria win TrustRadius awards. Learn more about the types of TrustRadius awards to make the best purchase decision. More about TrustRadius Awards
Popular Features
- Integration with web analytics tools (32)10.0100%
- Multi-domain support (28)10.0100%
- Site audit / diagnostics (50)9.696%
- Global SEO (27)9.191%
Reviewer Pros & Cons
Pricing
Paid Version
$149.00
Cloud
per year
Entry-level set up fee?
- No setup fee
Offerings
- Free Trial
- Free/Freemium Version
- Premium Consulting/Integration Services
Product Demos
Screaming Frog SEO Spider Demo
YouTube
Features
Return to navigation
Product Details
- About
- Tech Details
What is Screaming Frog?
Screaming Frog Video
Screaming Frog Demo
Screaming Frog Technical Details
| Deployment Types | Software as a Service (SaaS), Cloud, or Web-Based |
|---|---|
| Operating Systems | Unspecified |
| Mobile Application | No |
Comparisons
Compare with
Reviews and Ratings
(192)
Community Insights
TrustRadius Insights are summaries of user sentiment data from TrustRadius reviews and, when necessary, 3rd-party data sources. Have feedback on this content? Let us know!
- Business Problems Solved
- Recommendations
Screaming Frog SEO Spider is a versatile tool that has become indispensable for various user needs. Users appreciate its effectiveness in auditing client and internal websites, leading to business growth and improved site performance. It allows users to schedule automatic website crawls and receive the results via email, making it easier to identify regular technical issues without manual effort. The software offers a comprehensive solution for website audits and SEO analysis, streamlining operations and improving efficiency. It assists in identifying critical errors such as broken links, duplicate pages, and missing tags, facilitating website audits on a page level. Additionally, it helps users find pages that require attention and deep crawling for e-commerce sites. The software has garnered positive feedback from users who have found it easy to use, with a wide range of functionalities. It is highly recommended for digital marketing agencies and individuals conducting website audits.
Users have made several recommendations based on their experience with the software:
- The free version of the software is sufficient for making decisions and evaluating its usefulness.
- Purchasing the software is worth the money, as it provides comprehensive crawling capabilities.
- The software is recommended for companies of any size.
- It is suggested to try out the free version before committing to the premium subscription.
- The software is a great tool for finding 404 errors and checking meta data.
- Utilize the support documentation and forums for assistance.
- The software is great for internal SEO analysis and optimization.
- Try out the free version of the software.
- The software is recommended for crawling websites and gaining insights on content and keywords.
- Do not be intimidated by the technical aspects of the software and utilize available resources for guidance.
- The software is highly recommended for its cost-effectiveness and comprehensive website crawling capabilities.
Overall, users suggest taking advantage of the support documentation and forums provided by the software for assistance with any technical aspects and guidance.
Attribute Ratings
Reviews
(26-50 of 52)Companies can't remove reviews or game the system. Here's why
October 25, 2019
Site audits start here
Screaming Frog is where every site audit begins. More and more, Google cares about the integrity of a site's links, tags and page structure. Given the importance of search to our business, losing rank because of broken links and missing tags is an unacceptable loss. SF helps us make sure we're producing top-quality pages and maximizing our search potential.
- Validates tags.
- It helps with canonicalization.
- Corrects problems with no index.
- Checks internal and external links.
- Screaming Frog runs locally. It would be nice to see a pure cloud-based version.
- It's a very complete piece of software which means it can take a while to learn.
October 15, 2019
SEO Spider — One Spider You Won't Want to Get Rid Of
My company builds websites for clients, and something we focus on is SEO. That being said, it's important to the health of every website to ensure proper 301 redirects are in place before launching a brand new version of the website. If URLs change but old ones are still being crawled by search engines, this is a huge detriment to the visibility of the website.
As a champion for our clients, it's necessary to anticipate these changes before it becomes too late. Screaming Frog SEO Spider has made it extremely easy for us to pinpoint which URLs will need to be redirected. It completely takes the guesswork out of ensuring accuracy.
As a champion for our clients, it's necessary to anticipate these changes before it becomes too late. Screaming Frog SEO Spider has made it extremely easy for us to pinpoint which URLs will need to be redirected. It completely takes the guesswork out of ensuring accuracy.
- It's simple to use. Just add in the URL you need to crawl and within minutes, it's ready to go.
- It breaks down URLs and site components by HTML, Images, etc. so you know what to look for.
- It's easily exportable so you can download the spreadsheet and get to work.
- Because there's so much information given, it's difficult for a novice user to instantly understand where to look.
- The overall UX could use some updating. Next steps aren't always super clear.
September 27, 2019
Helps us save time during local SEO projects
We use Screaming Frog across our organization to address potential SEO issues on client websites, as well as to crawl sites for particular types of files (ex. images). It helps us perform day-to-day SEO tasks for our clients' websites.
- Lots of customization options on crawls
- Great at extracting in-depth, niche details about pages and websites
- Reliable--few to no glitches
- Can be intimidating for beginners due to dizzying array of options
- Customer service can be slow to respond
June 20, 2019
Simple and powerful crawler for websites
We are a small company that focuses on digital marketing and SEO service for our clients. Screaming Frog SEO Spider is a great tool to check out what internal structure a client website has. It works like Google robot and scans a website for links and makes list of website pages. After a full scan, you get a report about the basic info of these pages (meta tags, different kinds of errors) and you can create a sitemap with pages and images.
- You receive a report with internal structure of the website (Pages with status codes, depth structure)
- List of the pages with incorrect meta tags: meta titles & descriptions, also H1 tags
- List of the pages with insecure content and links to this content
- List with 404 errors and response codes
- List with pages where there is Google Analytics ID mismatch
- Can create sitemap with pages and images
- You can't pay per projects, only a subscription is available
- You need a lot of RAM for big websites (more then 10 millions pages)
- No cloud version
February 13, 2019
Weird name, solid SEO tool.
I currently use Screaming Frog as one of the tools for managing and maintaining our company websites. I primarily use the program for doing SEO audits. I use it to verify links and find broken ones, identify content types and scripts, find duplicate content, and create XML sitemaps. Analyzing our sites allows us to detect potential SEO issues proactively and make educated decisions about site content.
- Finds broken links (404 pages). Broken links hurt user experience.
- Identifies pages that include meta directives like nofollow/noindex/canonical etc. Helps understand what your pages tell crawlers to do.
- Get information about all of the internal and external links on my site (anchor text, links per page, etc). Helps in identifying key word choices and page weight.
- Requires Java. This isn't a huge deal as many computers already have it installed, but it's yet another 3rd party component.
- The free version has a crawl limit of 500 pages per site. This is fine for smaller sites, but if you're running a big e-commerce site then you'll need to pay for Pro version.
- The user interface isn't very pretty. This is an analytics tool so it doesn't really have to be, but it might be helpful for improving the overall user experience.
December 31, 2018
An Invaluable Tool for Technical SEO
Screaming Frog helps us identify pages with 404s, broken links, and canonical issues. We've used it for years to identify issues that would take significantly longer to identify without the app.
- It identifies broken links to a website and helps with link reclamation.
- It scans all pages on a site and provides status codes, helping identify areas that need fixing.
- It helps us easily download Titles and Descriptions for an entire website. This is particularly useful for SEO.
- It's a very pared down app and requires a decent amount of technical SEO expertise to fully comprehend. I don't necessarily think that's a bad thing, but it makes it difficult to understand for some first-time users.
December 21, 2018
Screaming Frog SEO Spider is #1 for Technical SEO Analysis
We use Screaming Frog SEO Spider to perform SEO audits for current and prospective clients. It allows us to get an all-encompassing view of the technical SEO elements of a website. I currently use only use the free version, as I find the cost prohibitive for what I use it for.
- Analyzes all metadata
- Character counts of all metadata
- identifies missing alt text on all images
- identifies all H1 and H2 headlines
- identifies broken links and loops
- The GUI is a little old school
- No cloud version is available...desktop version only (Chromebooks are SOL)
- Pricing isn't terrible...but there is no monthly option. £149.00 or roughly $190USD/yr.
November 30, 2018
Essential SEO Software
Screaming Frog is great for cataloging your pages and making sure that the basic SEO elements are on all pages. When you work for a large website, it's sometimes difficult to track ALL pages and sections. It's also used when we want to crawl our clients' websites to diagnose problems that can be easily addressed and fixed.
- Many data points
- Accurate info
- Ability to crawl pages on any website
- The tool (understandably) times out after crawling too many pages.
- Link metrics could be more detailed.
November 30, 2018
The best tool to have in your pocket, hands down.
Screaming Frog is a standard tool of operation since I introduced it a couple years ago. We use it to perform crawls of sites that we are auditing for SEO, crawls of sites we have built to check for errors, both in staging and development. The project management team now uses it to QA certain implementations of tags, or other aspects on the site.
- Best tool to crawl a site, hands down.
- Configurable for custom data extractions.
- In-depth exports for reporting.
- Configurable connections to Analytics and Search Console.
- Wealth of online documentation.
- Exporting one report at time to CSV or XSLX can be cumbersome and time consuming.
- Custom extraction requires pretty in-depth knowledge of RegEx or XPath.
- Not a very visual tool.
- Larges sites can take up a tremendous amount of resources (RAM, space, connection).
November 18, 2018
Screaming Frog is The Tool Every Web Dev Needs
We use Screaming Frog as a fundamental piece of our SEO strategy. The tool empowers us to dive deeper into information we find in Google Analytics and Search Console. We use it to crawl our external sites, discover 301 redirect chains, check on SERPs, and run basic visualization reports. It is essential to our technical SEO tactics.
- Quickly crawling sites with thousands of pages.
- Fantastic customer support and support portal.
- Great UI, very intuitive and not flashy.
- Great visualizations.
- Great export option which can be helpful when sending to those without access to the tool.
- Updates too frequently and is sometimes unclear on what the update is for. Since I use this on my work desktop primarily, I have to go through our help desk to update. Which turns a quick process into a much more involved, time consuming endeavor.
- An integration with a CMS (Drupal or WordPress in particular) seems like a great next step.
- Entry level technical SEO is easy to do. More advanced tools and reports can be difficult to find.
I've been using Screaming Frog SEO Spider for about a year now.
The tool is great for running a speedy SEO audit of an entire domain.
We got value out of the paid subscription after migrating a site over to a new URL format. It was useful for pinpointing all broken links which needed redirection.
I'd recommend the tool for anyone looking to get a bird's-eye view of there site's technical SEO health. I'd say it's good to have a basic understanding of technical SEO when using the tool. If you don't, I'm sure there are blog posts and downloaded content provided by Screaming Frog to guide your efforts.
The tool is great for running a speedy SEO audit of an entire domain.
We got value out of the paid subscription after migrating a site over to a new URL format. It was useful for pinpointing all broken links which needed redirection.
I'd recommend the tool for anyone looking to get a bird's-eye view of there site's technical SEO health. I'd say it's good to have a basic understanding of technical SEO when using the tool. If you don't, I'm sure there are blog posts and downloaded content provided by Screaming Frog to guide your efforts.
- Site wide Technical SEO analysis
- Pinpointing broken links
- Providing text based on page SEO details
- Fast run time
- Exporting features. There are good exporting features available, but when trying to export detailed information, it's hard to retrieve.
September 28, 2018
You'd be crazy not to have Screaming Frog SEO Spider as part of your SEO suite of tools!
Screaming Frog has generally been utilized only by myself in all SEO roles that I've had in the past, as well as now. I absolutely love Screaming Frog. It makes website audits so simple, but it's an incredibly powerful tool. It solves the problem of knowing what's going on in your site, and what you can solve to have better on-page SEO.
- Finding broken links on your site - I’ve yet to use a tool that lists broken links as simply as Screaming Frog SEO Spider.
- Finding redirect loops - These are rare, but when they happen, they’re annoying and can negatively affect your SEO. Luckily, Screaming Frog points these out very simply.
- Page analysis - Some other tools are more “plain speak” than Screaming Frog SEO Spider, and some may view this as a con. I see the technical side of this tool as an extreme benefit. In my world you can have easy or you can have powerful, but it’s extremely different to have both. As it relates to page analysis, it gives you simple, technical, actionable data to make your recommended changes.
- I have 0 complaints about Screaming Frog SEO Spider. What it claims to do, it does well. It’s the industry standard for sure. I don’t say this being biased - I’ve just tried many tools to do the things that this tool does, and Screaming Frog SEO Spider is my favorite.
August 21, 2018
The backbone of my SEO auditing toolset!
Screaming Frog is used primarily by the account management department, however it is also used occasionally by members of the business development and/or research teams. All who use it do so as part of technical SEO audits for clients. It can specifically help us identify crawling issues, indexation issues, necessary meta data changes, etc.
- Crawling client sites of up to thousands of pages. Gives you almost every tool that you need to do a proper SEO audit.
- Custom extractions using CSSpath, Xpath, or Regex. I'm not even a techy, but their support section here is a huge help with the provided examples.
- Customer service and support - Dan is ALWAYS very prompt to respond with helpful answers on Twitter if needed.
- I sometimes feel that it takes a lot of CPU power to do more basic audits. I've heard that others use tools like DeepCrawl for very large sites for this reason.
- Lately, I've been having some small issues with the search function, though in the past this has worked great so it could just be a bug. Dan and the team seem to be great at addressing these quickly!
- I'd like the ability to identify URLs which exist in an XML sitemap but are not linked to within a site's taxonomy. Currently the comparison between these two lists has to be done manually, as far as I know.
August 03, 2018
The first step in building an SEO program to last
Screaming Frog SEO Spider is used by the digital marketing team within the larger marketing department. It helps identify load speed, on-page SEO elements including title tags and meta descriptions, and assess technical health of website.
- Measure and report on load time and response codes of pages.
- Custom search can identify pages missing analytics tagging.
- Export on-page SEO elements to update title tags, meta descriptions, and alt tags.
- The ability to not only crawl pages for current elements but to push updates to them would be most helpful.
June 28, 2018
Nice Complimentary Platform
We use Screaming Frog to scan all URLs of a website. Then we parse the information off into sections: error codes, titles, meta descriptions, H1s and word count. It is then exported into Excel where we can analyze the current health of the site. This information provides us with great detail and a nice format where we can provide recommendations.
- Scans pages that we may not know exist.
- Provides a great export of information that can be manipulated into a useful document.
- Provides summaries of each area for a quick look at what elements need attention first.
- Sometimes a website is large enough that you can run out of memory. There is a way to fix that in the Screaming Frog platform, however I feel like it takes a programmer to figure out and configure the crawl. I wish there was an easy button!
I currently use Screaming Frog to analyze technical SEO aspects of the business. The software is primarily used to ensure that the code (HTML, JS) is up to scratch and that page load times are not negatively influenced by poor coding.
- A Fantastically quick crawl across all pages of the site
- Very easy exports for interpretation of data, sometimes very large data sets
- Very intuitive and easy to use
- Ability to deep dive using Regex
- While it is intuitive it could have a better GUI
- The functionality is there, but having a WIZYWIG would be good for entry level users
- The support level is somewhat lacking
April 27, 2018
An absolute gem for an SEO enthusiast
We used Screaming frog to scrape faulty pages of our massive website after a switch of the operating system. We also used it to collect meta-data stats to make sure our goals were met. All pages should have an H1, H2, and appropriate title. I was in charge to make sure these conditions were met. If your company doesn't accommodate to these variables there is a chance that your website will get less traffic. Search Engines use these conditions to index your website. You have to make sure when your result turns up in a search that the potential client will be triggered to click. This way Screaming Frog can be used as a complementary tool for Google Analytics to make sure your visitors will get the best user experience possible.
- Detailed scraping of metadata from every single page of a website
- Excellent export options to convert acquired data to excel
- Integration with Search Console for detailed analysis of pages
- Allows for individual page optimisation due to extensive reports
- It has quite the learning curve. In order to use all available assets you must be experienced with Google Analytics, data export and able to analyze this data as well
- Sometimes the integration of Search Console is not exactly flawless. It's hard to find the cause of this problem and it should be easier to fix this.
April 25, 2018
Good, well rounded SEO software
Screaming Frog SEO Spider was used to help us determine which pages on our website were missing important meta data.
- Scan your entire website for missing meta data.
- Easily allowed us to identify duplicate pages on our website.
- Assisted us in finding broken links quickly and easily.
- It would be nice if the free version scanned more than 500 pages and included the crawl configuration features. Even better would be if there was a free fully functional version available for a time limited period. This would allow us to better determine if the product would meet all of our needs.
April 25, 2018
Deep analysis, easy to use, flexible reports
I bought Screaming Frog to help review current and potential client onboarded websites. It helps me realize where bloat is, if there are any redirection errors, and generally be able to see the architecture and cross-linking of a site quickly. My primary use is to scan pages if I'm doing a rebuild and be able to accurately "see" any page that may not immediately be visible from front-end navigation.
- The ability to pare down any item on a site by "type"- HTML, image, scripts, etc
- A quick SEO response shows you pages with titles, without, with and without meta data so instead of combing through a site page-by-page (which is ridiculously time intensive) you can make an immediate actionable list
- It's fast. Even with ridiculously bloated sites it spiders rapidly and gives me a visual almost instantly. The various methods of reporting and exporting data are also useful. I use them all, but when reporting back to clients it can be helpful to have the charts and graphs vs just an export of cell data
- No real learning curve, all you have to do is input the URL you're looking for then the clearly labeled buttons and tabs help you start sorting what you're looking at
- I feel the top tabbing could be handled a little differently, though I'm not immediately sure how. Maybe two rows of tabs? There's so many that even on my 27" monitor it cuts off and the arrow down is almost lost beside the search arrow. I sometimes forget the other items off-screen exist
- Consider flattening the colors. While on the whole the muted color palette is fantastic and lets the data show, I feel the soft grey gradients behind bold text could honestly just become flat even color. That would allow things like buttons to pop more, with simple strokes and maybe a light color difference indicating buttons
- Make the bottom horizontal scroll bar on the main window more obvious. Almost always data is going to stretch further to the left and the bar blends in pretty closely with the stretching window beneath, and the arrows are too faint a grey. This sometimes obscures the fact there's deeper data to be seen if cut off at just the perfect point.
April 18, 2018
Deep Dive with Confidence
We utilized Screaming Frog SEO Spider on 2 fronts. The first was during the content audit process. This allowed us to gain visibility within our strategy department to the content that was available and begin analyzing those pages in depth during the audit process (especially when connected with Google Analytics natively in Screaming Frog). The second use was to analyze the client site from an SEO viewpoint. The ability to slice and dice the data was invaluable.
- Deep crawling to uncover site content
- Google Analytics connection to retrieve use data for pages crawled.
- Google Console connection to allow for deeper SEO understanding
- User interface takes some time to get used to. Not easy to just hop on and get started.
- When pulling Google Analytics data in to the system it defaults to a certain range would rather have this be a prompt to select.
- I would like to be able to have a mode for a quick crawl with possibly less data or be able to have it run outside of my computer system. There were instances where my computer(laptop) could not handle the load needed to crawl adequately.
Our entire organic search department utilizes Screaming Frog on all our technical website audits. The audit is quite lengthy, but the majority of the data can be pulled directly from Screaming Frog which makes our lives much easier.
- Finding website errors. Screaming Frog makes the process easy. You can find errors on an entire website all at once.
- Easily analyze Page Titles & Meta Data. In one view you can see an overview of the entire site including data such as title length, duplicate titles, and missing meta tags.
- Being able to generate XML sitemaps and customize is great.
- The speed of crawls can be an issue if you have a large website.
- The amount of memory used if you have a large website can be an issue.
- Maybe if there was more training videos/guides. I spend a lot of my time trying to figure out the perfect options for the site crawl I am looking for.
October 10, 2017
Great Crawl Tool for Any SEO Professional
I use Screaming Frog for adhoc competitor research, site health checks, page list building, sitemap creation and verification primarily. Any time a site health issue crops up that prompts someone to ask "can you quickly check XYZ?" it's typically easiest to go with Screaming Frog.
- Sitemap generation
- Adhoc site crawls with particular settings. For example, crawling all URLs on a specific subdomain or with certain URL parameters
- SEO attribute verification. Say you updated a title template and want to verify across a large batch of pages.
- Verifying redirects are in place
- Since its Java based desktop software, the memory management is always clunky
- It would be great to have a cloud based option. For instance something run off Amazon's cloud services.
- Easier management of license keys when switching computers
August 21, 2017
Screaming Frog - the best SEO website crawler there is.
Screaming Frog is peerless among SEO tools. The SEO individuals at Clicky use it for a range of different reasons, however, it is used by other people within the marketing team when necessary.
Screaming Frog is really the only tool that pulls out all relevant SEO-related information of a website. If we need all the page titles for each URL on a domain, or if we simply want all the URLs on a domain, we use Screaming Frog. We wouldn't be able to do our jobs without it.
Screaming Frog is really the only tool that pulls out all relevant SEO-related information of a website. If we need all the page titles for each URL on a domain, or if we simply want all the URLs on a domain, we use Screaming Frog. We wouldn't be able to do our jobs without it.
- Very quick at crawling a website.
- Pulls out comprehensive information for each URL.
- Able to export information to CSV files and others.
- Screaming Frog needs to have a function allowing the user to pull out ALL information, not just sections such as inlinks, outlinks etc.
- Users should be able to filter non-HTML pages with the click of a button, as opposed to having to manually exclude them.
- Visually, it could be improved.
April 17, 2017
Screaming Frog: Fast, Powerful and Expensive
We use Screaming Frog to analyze websites that fall into a number of categories:
- For websites that we create and manage: to watch for emerging problems like newly broken external links.
- For websites of new clients and prospective new clients: to analyze site structure for the sake of identifying defects and planning to repair them, as well as to detect internal and external 404s (broken links) for the sake of fixing or removing them.
- For websites of competitors to our company or competitors to our clients to look for opportunities to learn from what they have done well or done poorly.
- Crawls the structure of any website, producing a variety of reports that are useful
- Helps identify defects like broken links that need fixing
- The interface for Screaming Frog is "terse" and not easy to understand at first. With practice, though, it can be learned.
- The price is sinfully expensive.
September 16, 2016
Step Up your SEO Game w/ Screaming Frog
We use screaming frog for site audits and uncovering numerous challenges and opportunities within the site. The switch between Spider and list mode have been very helpful, as well as the recent SERP tool for creating a better approach to meta optimization for character count.
- Manage massive data
- Provide detailed instruction
- Intuitive user interface
- Pull search console data