The best tool to have in your pocket, hands down.
Overall Satisfaction with Screaming Frog SEO Spider
Screaming Frog is a standard tool of operation since I introduced it a couple years ago. We use it to perform crawls of sites that we are auditing for SEO, crawls of sites we have built to check for errors, both in staging and development. The project management team now uses it to QA certain implementations of tags, or other aspects on the site.
Pros
- Best tool to crawl a site, hands down.
- Configurable for custom data extractions.
- In-depth exports for reporting.
- Configurable connections to Analytics and Search Console.
- Wealth of online documentation.
Cons
- Exporting one report at time to CSV or XSLX can be cumbersome and time consuming.
- Custom extraction requires pretty in-depth knowledge of RegEx or XPath.
- Not a very visual tool.
- Larges sites can take up a tremendous amount of resources (RAM, space, connection).
- Allows for quick and easy business development audits, allowing us to generate net new income.
- Saves us time in the SEO department, hours saved is money earned.
- Saved a tremendous amount of time and resources across Dev and PM.
Screaming Frog is a desktop application that uses your own resources to crawl a site (Processing, RAM, Connection speed). Deep Crawl is a cloud-based crawler, and probably the best cloud based crawler out there. DeepCrawl can gather A LOT of data, but it becomes expensive. The larger the amount of pages you need to crawl and more projects you need open, the pricier it gets. If you know what you are looking at and don't need fancy charts and graphs, then Screaming Frog is the right tool for you over DeepCrawl.
Screaming Frog Feature Ratings
Using Screaming Frog SEO Spider
6 - SEO Department, SEM Department, Development and Project Management
2 - The more intricate you get with the use case of Screaming Frog the bigger the skillset it takes to support it. Myself and my SEO Manager support internal use cases, sometimes knowledge of ReGex and XPath to do custom extraction.
- SEO Auditing
- Quality Assurance with Dev
- Quality Assurance with Project Management
- We have a wide range of development clients, we use the tool to check updates to sites that the dev makes through custom extraction. When the change affects many pages, this makes it considerably easier to check changes as opposed to hours spent going page by page.
- For SEO auditing, I export my reports that I need from a site crawl and copy that data into a google sheet, I then use that sheet as a data source to visualize the data from the crawl. This allows us to easily create reports to clients.
- Allowing for easier methods of custom extraction (intsead of writing regex or XPath) would allow us to bring this out to more users in the company.
Evaluating Screaming Frog SEO Spider and Competitors
- Price
- Product Features
- Product Usability
- Product Reputation
- Prior Experience with the Product
- Third-party Reviews
Product Features is the most important selection from above. We need a tool that can be versatile and used across quite a few disciplines, and not just serve and SEO function. There are no other tools out there than can accomplish all that Screaming Frog has accomplished for us. We always look forward to any new features added in product updates.
I wouldn't change my mind. Screaming Frog is the best tool there is for us.
Screaming Frog SEO Spider Implementation
- Implemented in-house
Change management was minimal
- Training others who did not know the software how to use it. It was rather time consuming.
Screaming Frog SEO Spider Support
Pros | Cons |
---|---|
Quick Resolution Good followup Knowledgeable team Problems get solved Kept well informed No escalation required Immediate help available Support understands my problem Quick Initial Response | None |
I have had standard actions for support, however this also classifies for support, when my company switched over to invoice billing and no longer used credit cards, I had to reach out to screaming frog for assistance. I was answered immediately and after a brief explanation of what I needed from them, it was sent over right away. I also had a problem because of wording on the invoice from my billing department. I emailed them back and it was changed very quickly and got back to my billing department without a lapse in the software usage.
Using Screaming Frog SEO Spider
Pros | Cons |
---|---|
Like to use Technical support not required Well integrated Consistent Feel confident using | Slow to learn Lots to learn |
- A standard crawl is easy and can be accomplished by anyone
- Connecting to outside APIs
- Custom extraction is not easy to use without knowledge of RegEx (which I already knew) or XPath which I had to learn.
- With reporting you have to export each report separately instead of one workbook created, with multiple sheets. This can get very cumbersome when you need a lot of the reporting, especially the SERP reporting.
- For a beginner, it's hard to extrapolate the most important findings from your crawl.
- Getting the report to visualized.
Comments
Please log in to join the conversation