Screaming Frog, the Spider that Crawls Your Website
Screaming Frog SEO Spider allows me to easily review and scan the Gflenv.com website (as well as other company websites), for all of its …
Screaming Frog
Screaming Frog
Screaming Frog SEO Spider
Starting at $149 per year
View PricingOverview
Recent Reviews
Awards
Products that are considered exceptional by their customers based on a variety of criteria win TrustRadius awards. Learn more about the types of TrustRadius awards to make the best purchase decision. More about TrustRadius Awards
Best of
2021
Best of
2021
Popular Features
View all 14 features- Integration with web analytics tools (30)9.494%
- Multi-domain support (26)9.191%
- Site audit / diagnostics (48)8.585%
- Global SEO (26)7.575%
Reviewer Pros & Cons
View all pros & cons
Video Reviews
Leaving a video review helps other professionals like you evaluate products. Be the first one in your network to record a review of Screaming Frog, and make your voice heard!
Pricing
View all pricingPaid Version
$149.00
Cloud
per year
Entry-level set up fee?
- No setup fee
Offerings
- Free Trial
- Free/Freemium Version
- Premium Consulting / Integration Services
Features
Return to navigation
Product Details
- About
- Tech Details
What is Screaming Frog?
Screaming Frog Video
Screaming Frog Demo
Screaming Frog Technical Details
| Deployment Types | Software as a Service (SaaS), Cloud, or Web-Based |
|---|---|
| Operating Systems | Unspecified |
| Mobile Application | No |
Comparisons
View all alternativesCompare with
Reviews and Ratings
(186)
Attribute Ratings
Reviews
(1-25 of 51)- Popular Filters
Companies can't remove reviews or game the system. Here's why
September 26, 2022
Screaming Frog, the Spider that Crawls Your Website
Screaming Frog SEO Spider allows me to easily review and scan the Gflenv.com website (as well as other company websites), for all of its technical elements. This allows me to review it from an SEO perspective and to find any potential technical holes in the website, that need to be fixed.
- Review Technical Elements of a Website
- Review number of URLs on a website.
- Review Pictures of a website.
- No Training is provided w/ download of tool.
- Not everyone likes the excel like format.
- The number of tabs on the top can be a bit overwhelming for first time users.
August 31, 2021
Screaming Frog is the industry standard
We use Screaming Frog to crawl our website for Technical SEO errors. It allows us to check our site's health on a large scale. Instead of having to check each page manually, we're able to do it all at once. Only our SEO team uses it currently, but we are often exporting the results of the crawl and sharing it with our Dev team for fixes that need to be made.
- Find Broken Links.
- Crawl Site and Analyze Meta Data.
- Finding redirect chains and diagnosing technical errors.
- Sitemap cleanup/generation.
- UX/UI Improvements -- It's pretty ugly.
- Crawl Map -- It's a new feature and is improving, but it's still not amazing.
The main use of this software is in tracking down broken links within a given website. Screaming Frog is able to crawl an entire site based on the home page, then look at external links on each page and find out where they are no longer working - returning a specific HTTP head error (such as 404). The crawl results can be saved, so it's easy to return to a previous project. The software also offers a lot of SEO insight including anchor texts, indexability, meta titles, H1 and H2 usage, word count, file size and more.
- Scans all pages on a website.
- Quickly extracts valuable insight about each page.
- Clearly presents actionable SEO data.
- Interface layout is dense and a little intimidating to a new user.
- Slight learning curve to make the most of all the features.
I use Screaming Frog to perform site audits on both our own corporate sites and competitor sites. It’s a handy way to surface issues like error pages, redirect chains, and a host of other concerns. It’s also a good way to find a list of all the URLs available on our sites.
- You can easily scan any site.
- With the paid version, there is no page limit for scans.
- It provides a wide variety of information about the URL that you scan.
- Reduce the amount of system resources each scan requires.
- Create an easy way to compare multiple URLs to make competitive analysis easier.
- Improve the backlink capabilities.
May 19, 2021
Screaming for Screaming Frog
My team and I use Screaming Frog to crawl websites to better understand the site hierarchy, unravel internal linking structures and verify live links across hundreds of domains. We can also easily find and download page titles, descripts and H1 tags in addition to the canonical links a page. What you can do with Screaming Frog is really limited by your imagination and desires. Our entire SEO team uses the product with every client that we touch and as a whole, the company has integrated Screaming Frog into every phase of the sales funnel. Our sales team uses it to estimate how big a site is and how many hours might be needed while our marketing team uses it to find the best placement for creative materials. It helps us to find information on a site without manually sifting through each webpage.
- Check status codes for a set of URLs - Simply copy and paste the URLs into the open box and within minutes you are able to see the status code, response time and potential redirects for any of the URLs. While there are online versions of this, Screaming Frog has the best copy/paste option and includes any other URL data you might need as well.
- Crawl URLs for a Custom Text - Without developing your own spider, there is no other way to do this other than visit each URL individually. This has saved us countless hours verifying proper analytics code implementation across an entire website and finding client mentions across hundreds of links.
- Finding Canonical Links - Every time Screaming Frog crawls a link or site they report back the basic information which happens to include canonical links. Again, without building your own spider or reviewing hundreds of URLs it would be a lengthy task to find all of this information.
- Customizing the crawler - It takes a little bit of playing around with the settings to understand what each of them controls and what options need to be checked or unchecked to get the right amount of information.
- Cannot Crawl a large site - Screaming Frog runs out of memory when asked to crawl a large site, even after playing around with memory settings and allocating additional memory.
May 06, 2021
Screaming Frog is fantastic!
We use it to check technical SEO factors of various company websites. It helps us to recognize any issues, errors, or opportunities with our sites to be able to better optimize them. Screaming Frog gives us all the technical information we need to be able to make our websites better, basically!
- Very fast to crawl a site.
- Tons of features.
- Not flashy: Everything is data driven which is great.
- Fast
April 27, 2021
Implementing with Screaming Frog
We use Screaming Frog SEO Spider to analyze clients' websites prior to us building them a new site. With Screaming Frog SEO Spider I can look at the sitemap of a site very easily and discover any hidden pages that may exist on that website. Overall it is a pretty useful tool that our Implementation department utilizes quite frequently.
- Finding sitemaps
- Seeing what pages are classified as
- Easy to use
- Old look and feel
- Can be overwhelming amount of information
- Have a guide or tutorial
April 24, 2021
A perfect tool for quick website audit!
Screaming Frog SEO Spider is [the] one-stop solution for website audit. It is Quick, reliable, and user-friendly. It provides all the technical and on-page details. Helps in quickly optimizing the website. Shows most of the required data [that] any SEO would need.
- User Friendly
- Quick
- Provides Detailed Data
- Providing more suggestions [on] how things can be improved
April 22, 2020
Screaming Frog SEO
Screaming Frog is used by SEO Specialists in the whole organization. With Screaming Frog, we get crawling and indexing issues to be solved.
- It is easy to use.
- Can be integrated with Google Lighthouse
- Can be integrated with Google Search Console
- We can extract some extra information from our website.
- It is not a cloud software.
- For large websites we need to wait a lot.
February 23, 2020
You’re aren’t a “real” SEO expert if you aren’t using ScreamingFrog
We used Screaming Frog SEO Spider to audit our content across over a dozen websites under our company. The Digital Marketing team is using it. It’s helping us evaluate our content and organize the details of all of it, so we can make data-driven decisions promptly without having to do a manually report for all of our sites (each with about 200-1,000+ pages)
- The crawl and subsequent report are fast
- It integrates with Google Analytics
- Help pull more historical data (it only pulls “Last Modified”).
- Have an option to “hide” PDFs from the link score/crawl analysis.
January 23, 2020
Fast and accurate web crawler for SEO projects.
We use Screaming Frog SEO Spider in our marketing team to solve a number of website related problems. We initially started using Screaming Frog SEO Spider to crawl websites we were working on to develop a list of pages, titles, meta data, and more. We use this data as a basis for our website content audits.
- Website crawling.
- Meta data extraction.
- Free version limited.
January 22, 2020
Big time-saver and makes technical SEO life so much easier!
We use it for technical SEO audits, checks, and QA. It has helped us scale efforts in those areas.
- Audit redirects en masse - important bc stuff like that would take forever to do manually.
- Site launch audits - again, it would take forever to check the technical aspects of a site launch manually.
- Site speed measurement could be added/approved. Current page speed functionality is helpful at times but could be more robust.
January 18, 2020
Great free tool for small SEO budgets
When doing SEO for any of our websites, I like to start by using Screaming Frog to crawl the site. This gives me a starting point to examine meta data, see how discoverable the pages are on the website, and build the sitemap for submission. This is especially useful on web platforms that don't have their own sitemap generator.
- Sitemap building.
- Site crawling.
- The UI is a bi confusing, especially for the uninitiated.
- Though very customizable, default settings can cause server issues due to high traffic.
Our digital agency uses Screaming Frog to help with website audits specifically for SEO related information including metadata, URLs, page titles, response codes, etc. We also use the tool for new website launches to crawl the current site and export URLs to aid with the creation of 301 redirects when necessary.
- Website crawler is solid, making it easy to export into a spreadsheet.
- Analyzes page titles and meta data of your website to help with SEO.
- The UI is a little dated but has improved in recent years.
- Not as intuitive for new users, requires some getting used to and experimenting.
January 16, 2020
This Frog Screams Digital Marketing Insights
Having been doing SEO for 20 plus years - Screaming Frog SEO has been a tool that since it first launched that I have used consistently. It crawls a site and gives insights into all areas that technical SEO needs to examine. I highly recommend this tool - use it - learn how to read the numbers and develop responses to the information - whether it is duplicate tags and content, use of H tags, internal and external linking - the tool covers all the areas you need to improve the organic rankings of your site
- Check title and description lengths
- See duplicate title and descriptions
- Could break results out into categories to streamline and quicken the process.
- The schema information is lacking.
January 08, 2020
Screaming Frog SEO Spider is no toad!
Screaming Frog is our go-to audit tool when first looking at a potential new project. Even the free version of Screaming Frog is quite useful. It is used company-wide and it the fastest way we have found to get a good "look" at the on-page health of a site. And with the paid version it allows integration with Google Analytics and Search Console (WMT). With SF and Google Sheets you can build a fairly comprehensive overview of metas, alt tags, image size, titles, H tags, etc. in a very short amount of time.
- A solid crawler with a lot of options.
- Allows one to see the core SEO elements of a site very quickly.
- The paid version is a bit pricey but for what it does it's worth it.
- The UX can see a bit confusing at first, but once you begin to use it the learning curve is quick.
January 07, 2020
A thorough web crawler with helpful SEO and site info
It is used by the SEO department for crawling and website troubleshooting needs. It helps us see all URLs on a site. It helps us notice if there is missing or duplicative metadata. It helps identify 404s or other issues with URLs. It also helps generate an xml sitemap file.
- Crawling an entire website
- Gathering all URLs on the site
- Telling you where a 404ing URL was found on the site
- It crashes sometimes when you first open it
January 07, 2020
Screaming Frog is An Excellent Tool for SEO
I use Screaming Frog for every one of my clients. It allows me to quickly see if there are any underlying issues with their web pages that can be addressed to help with their rankings or usability. One crawl and I can filter in many ways to view just the data I need.
- Allows me to see what pages can be indexed by the search engines
- Shows me quickly if there is any meta information missing
- If I am working with a larger site it's difficult to get Screaming Frog to scan the whole site. I have to stop the scan and reset some settings to get it to work and even then I have had issues.
December 30, 2019
Screaming Frog - A Go-to Technical SEO tool
Our organization specializes in marketing and website audits. Screaming Frog is the first thing we fire up when investigating a website, be it our client or the competition. This way we immediately see how a website is perceived in the eyes if Google, what pages are properly indexed or not, title and meta tags and even Google Analytics data.
Screaming Frog is the perfect diagnostics tool for any website auditor and a starting point for any digital marketing campaign.
Screaming Frog is the perfect diagnostics tool for any website auditor and a starting point for any digital marketing campaign.
- Website crawling - see any website the way search engines see it.
- Technical SEO - find out which pages have difficulties being indexed and improve alt tags, canonical tags, redirects, Schema.org, sitemaps, etc.
- Onsite SEO - improve title tags, header tags, description tags, etc.
- Exporting data - not the best way of naming the files you export, also you cannot export graphs that are generated in the sidebar.
- Crawling large websites - it takes a lot of memory and takes a lot of time (sometimes days), they could consider creating a SaaS for these cases.
- Doesn't crawl content so no data regarding duplicate or similar content is generated.
I use as part of my audit process with every new client as well as clients looking to develop new websites. It is ideal for capturing all of the pages on the site along with meta information, different page types, finding 301 redirect issues, word counts, meta tag character counts, and much more.
- Fast crawling even on large websites.
- Comprehensive listing of pages of all types, not just HTML.
- All meta tag information including character counts.
- Page word counts in order to identify thin-content pages.
- Would be great to have backlink information.
- Would be great to get more guidance on what words or phrases a page should be optimized for.
- Would be great to identify pages with duplicate or extremely similar content.
November 08, 2019
Don't tell my clients how easy Screaming Frog makes my job!
It's used in the search and analytics department. I use it for crafting pitches - getting insights on possible site issues on a client site - troubleshooting any site issues for active clients, and completing audits, particularly tracking internal linking webs, scraping metadata, and assessing status code issues - both within the web app and in Excel spreadsheets.
- I love the ability to scrape all internal links on the site - even with anchor text! Great for troubleshooting site circulation.
- The Building Tree view is useful for quick visualization of the site structure.
- I just love being able to scrape all the metadata - makes the setup for optimization super easy.
- The Crawl Tree Graph always seems like it would be great, but the output is extremely unwieldy
- Sometimes the status codes come out wrong - I always feel the need to double-check a few, when I end up with a list of 404s—and often I need to run them again in list mode to get the proper code. Not sure why!
- I wish you could save a crawl within the platform - say I crawl a site, then crawl a different one, and want to poke around within the platform at that first site again. It seems I just have to perform the crawl again, rather than being able to load up an old crawl.
November 07, 2019
Screaming Frog Review
We use Screaming Frog to give a high-level overview and almost a self-audit style report on our site health. Screaming Frog's crawling capabilities make pulling reports quick and convenient. The content of the reports gives us a total aerial snapshot of site pages and allows for quick changes to be made.
- Quick crawls.
- The free version is pretty comprehensive.
- Reports able to pull in CSV format.
- Premium version could be cheaper.
- Integration with other analytics tools - Currently just GA.
- A scheduling option for the free version would be great.
October 25, 2019
A Fast and Easy Way to Explore SEO Opportunities on Any Website
Screaming Frog is essential to providing SEO services to all my clients. We also use it for gaining insights about our own website. It's great for winning potential clients because it very quickly and easily reveals issues with their websites. And finally, it's just good for making the back-end of any website transparent, which is helpful for other aspects of marketing, i.e., exploring the competition.
- It has a reliable user interface that makes it easy and fast to scan a website.
- Reveals issues and opportunities for website optimization.
- It allows you to filter results, so you can drill down to where the problems are.
- You can export lists, so clients can either fix issues themselves or it's "proof" of what you're working on for them.
- There's a bit of jargon in terms of labeling, and with so much data available, it would be nice to have "inline" explanations of what we're looking at.
- Perhaps better graphical representations of the data, which would be helpful when explaining it to clients.
- Maybe offer recommendations for fixing issues that are found with a website?
October 25, 2019
Site audits start here
Screaming Frog is where every site audit begins. More and more, Google cares about the integrity of a site's links, tags and page structure. Given the importance of search to our business, losing rank because of broken links and missing tags is an unacceptable loss. SF helps us make sure we're producing top-quality pages and maximizing our search potential.
- Validates tags.
- It helps with canonicalization.
- Corrects problems with no index.
- Checks internal and external links.
- Screaming Frog runs locally. It would be nice to see a pure cloud-based version.
- It's a very complete piece of software which means it can take a while to learn.
October 15, 2019
SEO Spider — One Spider You Won't Want to Get Rid Of
My company builds websites for clients, and something we focus on is SEO. That being said, it's important to the health of every website to ensure proper 301 redirects are in place before launching a brand new version of the website. If URLs change but old ones are still being crawled by search engines, this is a huge detriment to the visibility of the website.
As a champion for our clients, it's necessary to anticipate these changes before it becomes too late. Screaming Frog SEO Spider has made it extremely easy for us to pinpoint which URLs will need to be redirected. It completely takes the guesswork out of ensuring accuracy.
As a champion for our clients, it's necessary to anticipate these changes before it becomes too late. Screaming Frog SEO Spider has made it extremely easy for us to pinpoint which URLs will need to be redirected. It completely takes the guesswork out of ensuring accuracy.
- It's simple to use. Just add in the URL you need to crawl and within minutes, it's ready to go.
- It breaks down URLs and site components by HTML, Images, etc. so you know what to look for.
- It's easily exportable so you can download the spreadsheet and get to work.
- Because there's so much information given, it's difficult for a novice user to instantly understand where to look.
- The overall UX could use some updating. Next steps aren't always super clear.