Screaming Frog SEO Spider vs. Similarweb

Screaming Frog SEO Spider is well suited to auditing brand new websites, when you need a quick, holistic view of the websites technical issues. Its great for providing a top line view of a websites architecture, perhaps for a new business approach where you need to assess the scale of work to maintain a website. Its also a useful tool in situations where you might need to see whether a large scale change in the website has taken place, you can see word counts, pages and their https response codes. Screaming Frog may be less useful if you need an idea of the customer experience on a website, it doesn't really provide information that helps assess how fast a website loads, what issues might come up when trying to convert or faults with the payment process. Screaming Frog is largely a technical SEO focused tool, it also can't assess the quality of a websites, layout or the quality of the content used on the website. As mentioned, its niche, but very useful within that niche.

Similarweb is our go-to tool for SEO research. We can identify high-value keywords, track our rankings, and monitor changes in our website's traffic. This data is invaluable for optimizing our content and ensuring we rank high on search engine results pages.

Incentivized

• Crawling client sites of up to thousands of pages. Gives you almost every tool that you need to do a proper SEO audit.
• Custom extractions using CSSpath, Xpath, or Regex. I'm not even a techy, but their support section here is a huge help with the provided examples.
• Customer service and support - Dan is ALWAYS very prompt to respond with helpful answers on Twitter if needed.

Incentivized

• Competitive Analysis: Similarweb has provided us with a comprehensive toolkit for analyzing web traffic and audience behavior for various sports teams, leagues, and players. We can compare and contrast their online presence, helping us gain a competitive edge by understanding their digital strategies.
• Sponsorship Decisions: Making informed sponsorship decisions is vital in sports. Similarweb assists us in evaluating potential sponsorships by providing insights into the online presence and reach of potential partners.
• Audience Demographics: One of the standout features of Similarweb is its ability to provide detailed audience demographics. We can pinpoint the age groups, locations, and interests of online visitors, which is crucial for tailoring content, promotions, and sponsorship deals effectively.

Incentivized

• Requires Java. This isn't a huge deal as many computers already have it installed, but it's yet another 3rd party component.
• The free version has a crawl limit of 500 pages per site. This is fine for smaller sites, but if you're running a big e-commerce site then you'll need to pay for Pro version.
• The user interface isn't very pretty. This is an analytics tool so it doesn't really have to be, but it might be helpful for improving the overall user experience.

Incentivized

• Sometimes I find it takes time to find exactly where a certain analysis I had looked at previously is when I go to replicated. Website could be streamlined that way.
• You can only compare 5 companies at a time on the website but often I'd like to compare more. You can always download the data to compare two different searches, but that adds time.

Incentivized

The tool has become integrated into our teams daily workings and I have yet to find a tool other than scremaing frog to replicate all of our use cases for it. It's a great tool and we're sticking with it

Incentivized

I use it every single day and its essential to succeeding in my role

Incentivized

The Screaming Frog crawler can do a very exhaustive SEO page audit. It is able to detect errors like 4xx, 5xx, 3xx, etc on page. It is also able to check basic SEO hygiene on the page like missing page title, lengthy page title, etc. It can also check advanced SEO stuff like missing canonical or hreflang.

Incentivized

Similarweb is a very easy to use tool and gives us data on the go. It takes only a few clicks to get the relevant data. However, I have deducted 2 points as it only allows us to add 5 websites at a time on the platform, and data availability is only for the last 37 months.

Incentivized

Screaming Frog is a relatively primitive system, and doesn't need to be supported by devs or other software. Screaming Frog does interface directly with some programs that are most needed (Google Analytics, Search Console, Page Speed Insights), so that's convenient. It isn't widely supported by other programs, but it also doesn't need to be.

Incentivized

Support is just helpful and effective when you need them; we have only needed to contact them once about a misunderstanding while setting up our Market Analysis. Since we don't really contact them too often, it's hard to offer anything but a positive rating from the single positive experience we had with tech support.

Incentivized

If the software was a little easier to use for beginners, there really wouldn't be an issue

Incentivized

We liked it, things can always be better

Incentivized

Screaming Frog SEO Spider is probably the best non-client facing SEO audit tool in terms of technical SEO. There are other tools on the market that do a more complete job of keyword tracking, competitive analysis, and backlink profiles...however, for analyzing the technical SEO health of any website, Screaming Frog is the best

Incentivized

Whilst data.ai has strong app competitor intelligence data, Similarweb do a better job of showing the upstream and downstair behaviour across desktop and mobile web. Additionally, Similarweb's channel marketing mix goes deeper and allows us to understand a wider set of channels and be able to get a holistic understanding of our overall marketing strategy performance

Incentivized

• Increased employee efficiency - We spend many less hours tracking down and reporting simple meta tags.
• Better Client Servicing - We are able to ensure we have a total look at a client's site before we recommend anything.
• True Pricing Structure - We are able to more accurately predict how much help a client may need based on factors such as size of site, number of redirects, proper use of meta tags, etc.

Incentivized

• Boosting Organic Search Traffic: By leveraging the data and insights provided by Similarweb PRO, we have helped several businesses significantly improve their traffic from organic search. The platform's keyword research, competitor analysis, and market trend identification capabilities have enabled us to create tailored and effective SEO strategies for our clients, resulting in increased visibility and traffic growth.
• Securing New Projects: Similarweb PRO's unique insights have given us a competitive edge in the consulting space, allowing us to secure projects by offering valuable information that other firms could not provide. Our ability to analyze competitors' strategies, track market trends, and assess marketing channel effectiveness using Similarweb PRO's data has made us stand out among other consulting firms, ultimately leading to new business opportunities and project wins.

Incentivized