New Relic vs Sauce Labs | TrustRadius

What users are saying about

Score 8.1 out of 10

Based on 156 reviews and ratings

Score 7.4 out of 10

Based on 218 reviews and ratings

Feature Rating Comparison

New Relic

Sauce Labs

Application monitoring

Database monitoring

Threshold alerts

Predictive capabilities

Application performance management console

Collaboration tools

Out-of-the box templates to monitor applications

Application dependency mapping and thresholding

Virtualization monitoring

Server availability and performance monitoring

Server usage monitoring and capacity forecasting

IT Asset Discovery

Pros

New Relic lets you drill down into the nitty-gritty of your application, breaking down requests however far you want in order to inspect the performance of your application throughout the request lifecycle.
New Relic offers many integrations with other services and technologies, making it easy to get it set up and start using it.
New Relic offers many views and types of visualizations to help you understand what's going on in as much detail as you want to know.

Read full review

Head of Development Technologies

Top Floor TechnologiesInternet, 11-50 employees

View all 48 answers on this topic

Incredibly cheap.
The service is outstanding. They provide me with the combinations of browsers/platforms that make it easy for me to do my job.
Sauce Labs accelerates and optimizes the tests by running them through console logs, metadata, and Selenium with complete lists of compatible commands.

Read full review

Dishank Vishnoi

Senior Consultant

AreteansComputer Software, 10,001+ employees

View all 120 answers on this topic

Cons

Cloud-centric / OS-centric. There is no/limited ability to query metrics with an agent installed.
Insights-based queries (dashboards and alerts) are limited to 1000 (soon to be 2000) records and that doesn't work for enterprise scale.
NRQL is awesome -- except when it isn't. The replacement QL is more robust but is significantly more complex to learn.
No agent management tools in the platform. And, yes, you will want agent management tools after the first dozen or so deployments.

Read full review

Verified User

Engineer in Information Technology

Hospital & Health Care Company, 10,001+ employees

View all 48 answers on this topic

Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.
Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.

Read full review

Senior QA Engineer

Bleacher ReportSports, 201-500 employees

View all 120 answers on this topic

Likelihood to Renew

New Relic 8.0

Based on 9 answers

I have not yet found any similar product that offers me this range of features to help us keep our online service fast and reliable. Besides this, New Relic is constantly evolving by adding new plugins to emerging technologies and platforms. Server performance measuring features are a key point as our user database grows.

Read full review

Verified User

Analyst in Information Technology

Information Technology and Services Company, 51-200 employees

View all 9 answers on this topic

Sauce Labs 8.4

Based on 16 answers

Sauce Labs has become an integral part of our entire continuous delivery pipeline. Our architectural vision for CI/CD simply would not be possible without Sauce Labs given the resource constraints our company has to develop and maintain a solution such as this internally.

Read full review

Lead Software Test Automation Engineer

ARMS Business SolutionsInformation Technology and Services, 51-200 employees

View all 16 answers on this topic

Usability

New Relic 9.0

Based on 3 answers

New Relic interface can be tricky to setup sometimes, especially on dashboards, but the overall usability is great. We also find particularly interesting the chart creation tools. There are no major issues that prevented us using any of their services.

Read full review

Verified User

Analyst in Information Technology

Information Technology and Services Company, 51-200 employees

View all 3 answers on this topic

Sauce Labs 7.9

Based on 13 answers

I think Sauce Labs is great and I've been using them since late 2014. With that said, I'm very used to how their interface works and how to get what I need. I think if a brand new user would come in and use it, it would still be easy, but maybe not as easy as it is for me. That's why I rate this area a 9 instead of a 10. Still great though!

Read full review

Senior Software Development Test Engineer

SecureAuth CorporationInformation Technology and Services, 51-200 employees

View all 13 answers on this topic

Reliability and Availability

New Relic 10.0

Based on 1 answer

we have never had any down time issues!!!

Read full review

Jayson E. Conry

Lead Monitoring Engineer

Cambia Health SolutionsHealth, Wellness and Fitness, 5001-10,000 employees

View all 1 answers on this topic

Sauce Labs 9.0

Based on 3 answers

Outages with the virtual machine services or the Sauce Connect Proxy service are more frequent than would be ideal, but updates to resolutions are communicated frequently, and resolutions usually come quick.

Read full review

Lead Software Test Automation Engineer

ARMS Business SolutionsInformation Technology and Services, 51-200 employees

View all 3 answers on this topic

Performance

New Relic 8.0

Based on 1 answer

there are times where browser cache will cause issues that require you to clear your browser before continuing.

Read full review

Jayson E. Conry

Lead Monitoring Engineer

Cambia Health SolutionsHealth, Wellness and Fitness, 5001-10,000 employees

View all 1 answers on this topic

Sauce Labs 9.0

Based on 3 answers

The execution of automated tests in Sauce Labs virtual machines is slightly slower than its main competition. Furthermore, the spin-up time of virtual machines (particularly device simulators or emulators) is significantly slower in our experience than its primary competition. The Sauce Connect Proxy further adds to performance decrease when used in our experience (around 10%-20% decrease when used), such that each call to the remote WebDriver instance in your test scripts can take upwards of 100-200 milliseconds.

Read full review

Lead Software Test Automation Engineer

ARMS Business SolutionsInformation Technology and Services, 51-200 employees

View all 3 answers on this topic

Support Rating

New Relic 8.0

Based on 3 answers

There are times I feel that the initial support is lacking. And in some cases the automated responses of not hearing anything are annoying if the reason why there has been no movement is because we are still waiting to hear back from NR support. So, i think they should loose the automation as it can seem disingenuous

Read full review

Jayson E. Conry

Lead Monitoring Engineer

Cambia Health SolutionsHealth, Wellness and Fitness, 5001-10,000 employees

View all 3 answers on this topic

Sauce Labs 7.1

Based on 12 answers

The support is good for Sauce Labs. It is hard to get an initial response but the support has cleared our issues with Sauce Labs. Sometimes we have to follow up and it's hard to get a hold of the team initially. Once we get a hold of the team, the issues are always resolved.

Read full review

TDP Sr Associate

Optum (formerly Alere Wellbeing)Computer Software, 10,001+ employees

View all 12 answers on this topic

Implementation Rating

New Relic 8.5

Based on 4 answers

The documentation was clear and concise; the only issue we ran into was custom application naming. Due to HTTPD mod_fcgid and the need for the application name to be set in php.ini (not in .htaccess or the virtual host directive) ... we had issues setting this up.

Read full review

Systems Engineer

Penton MediaInformation Services, 1001-5000 employees

View all 4 answers on this topic

Sauce Labs 7.9

Based on 7 answers

I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started

Read full review

TDP Sr Associate

Optum (formerly Alere Wellbeing)Computer Software, 10,001+ employees

View all 7 answers on this topic

Alternatives Considered

We had originally looked into CloudWatch to monitor our resources since we have our stack built in AWS, but found that it would take additional work to setup the dashboards, alerts, and details that we wanted to see in our reports. It was worth the additional investment for us to get the data we needed with less work.

Read full review

Software Development Director

Fresh ConsultingInternet, 51-200 employees

View all 48 answers on this topic

We found Sauce Labs to be better in the following:1) Better selection of mobile devices (including all the new devices)2) Supports many CI tools like Jenkins, CircleCI3) Availability of test metricsWe also had a better experience using Sauce Labs overall. It was easy to create users in the application. It is also very easy to get your existing automated test suite running on Sauce Labs.

Read full review

Vignesh Viswanathan

Enterprise Software Quality Architect

Quicken LoansResearch, 10,001+ employees

View all 120 answers on this topic

Scalability

New Relic 8.0

Based on 1 answer

It's easy to scale. However, it isn't as easy to keep track of costs and who own's what/

Read full review

Jayson E. Conry

Lead Monitoring Engineer

Cambia Health SolutionsHealth, Wellness and Fitness, 5001-10,000 employees

View all 1 answers on this topic

Sauce Labs 9.1

Based on 3 answers

The product is as scalable as your company's wallet can afford, since you are charged per unit of concurrency, where each new unit of concurrency represents another concurrent virtual machine you can spin up.

Read full review

Lead Software Test Automation Engineer

ARMS Business SolutionsInformation Technology and Services, 51-200 employees

View all 3 answers on this topic

Return on Investment

New Relic helps us detect defects before our customers do.
New Relic helps us prioritize performance improvements. Engineers don't need to spend time measuring the latency of transactions themselves.
New Relic helps us notify the appropriate people rapidly when there are problems.

Read full review

Verified User

Engineer in Engineering

Research Company, 11-50 employees

View all 48 answers on this topic

Sauce Labs is less expensive than setting up the same amount of OS/browser combinations locally
But real mobile devices are too expensive, so it's cheaper to buy and set it up locally
But overall it's still a good investment

Read full review

Dmitry Shyshkin

Lead QA Automation Engineer‏

FareCompare.comMarketing and Advertising, 11-50 employees

View all 120 answers on this topic

Screenshots

—

Pricing Details

General

Free Trial

—

Free/Freemium Version

Yes

Premium Consulting/Integration Services

—

Entry-level set up fee?

No

General

Free Trial

Yes

Free/Freemium Version

Yes

Premium Consulting/Integration Services

Yes

Entry-level set up fee?

Optional

Rating Summary

New Relic

Sauce Labs

New Relic

Sauce Labs

New Relic

Sauce Labs

New Relic

Sauce Labs

New Relic

Sauce Labs

New Relic

Sauce Labs

New Relic

Sauce Labs

New Relic

Sauce Labs

Add comparison