Overview
ProductRatingMost Used ByProduct SummaryStarting Price
CloudTest
Score 10.0 out of 10
N/A
Akamai now owns and supports CloudTest, a load and performance testing solution, developed by SOASTA and acquired with the company in 2017.N/A
New Relic
Score 7.9 out of 10
N/A
New Relic is a SaaS-based web and mobile application performance management provider for the cloud and the datacenter. They provide code-level diagnostics for dedicated infrastructures, the cloud, or hybrid environments and real time monitoring.
$0
No credit card required; 100 GB free ingest per month, 1 free full user + unlimited basic users, 8 days retention, 100 Synthetics Checks
OctoPerf
Score 9.0 out of 10
N/A
OctoPerf is an enterprise-grade performance and load testing platform available both as SaaS and on-premise, designed for engineering teams working on modern, distributed applications. It enables teams to simulate realistic user traffic, identify performance bottlenecks, and validate application scalability through scalable load test execution. By combining advanced load modeling, deep performance analytics, and flexible deployment options, OctoPerf supports a wide…
$69
per month
Pricing
Akamai CloudTestNew RelicOctoPerf
Editions & Modules
No answers on this topic
Free (Forever)
$0
No credit card required; 100 GB free ingest per month, 1 free full user + unlimited basic users, 8 days retention, 100 Synthetics Checks
Telemetry Data Platform
$0.25
per month per extra GB data ingest (after first free 100GB per month)
Incident Intelligence
$0.50
per month per event (after first 1000 free events per month)
Standard
$99
per month per full user (after first free full user - unlimited free basic users)
Pro
Contact sales team
Enterprise
Contact sales team
Basic
$149
per month
Pro
$649
per month
Free
Free
On Demand
Contact sales team
Offerings
Pricing Offerings
CloudTestNew RelicOctoPerf
Free Trial
NoNoYes
Free/Freemium Version
NoYesYes
Premium Consulting/Integration Services
NoNoYes
Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
Additional DetailsBoth pay-per-test and subscriptions are available.
More Pricing Information
Community Pulse
Akamai CloudTestNew RelicOctoPerf
Features
Akamai CloudTestNew RelicOctoPerf
Load Testing
Comparison of Load Testing features of Product A and Product B
Akamai CloudTest
7.2
1 Ratings
17% below category average
New Relic
-
Ratings
OctoPerf
9.4
1 Ratings
10% above category average
End to end performance management6.01 Ratings00 Ratings10.01 Ratings
Integrated performance data8.01 Ratings00 Ratings9.01 Ratings
Deployment model flexibility9.01 Ratings00 Ratings9.01 Ratings
Real time monitoring6.01 Ratings00 Ratings9.01 Ratings
Automated anomaly detection7.01 Ratings00 Ratings10.01 Ratings
Best Alternatives
Akamai CloudTestNew RelicOctoPerf
Small Businesses

No answers on this topic

InfluxDB
InfluxDB
Score 8.8 out of 10

No answers on this topic

Medium-sized Companies
ReadyAPI
ReadyAPI
Score 6.2 out of 10
Sumo Logic
Sumo Logic
Score 8.8 out of 10
ReadyAPI
ReadyAPI
Score 6.2 out of 10
Enterprises
ReadyAPI
ReadyAPI
Score 6.2 out of 10
NetBrain Technologies
NetBrain Technologies
Score 9.2 out of 10
ReadyAPI
ReadyAPI
Score 6.2 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
Akamai CloudTestNew RelicOctoPerf
Likelihood to Recommend
8.0
(1 ratings)
7.9
(145 ratings)
9.0
(1 ratings)
Likelihood to Renew
-
(0 ratings)
8.8
(16 ratings)
-
(0 ratings)
Usability
-
(0 ratings)
8.4
(11 ratings)
-
(0 ratings)
Availability
-
(0 ratings)
9.1
(2 ratings)
-
(0 ratings)
Performance
-
(0 ratings)
9.1
(2 ratings)
-
(0 ratings)
Support Rating
-
(0 ratings)
9.0
(7 ratings)
-
(0 ratings)
Implementation Rating
-
(0 ratings)
8.0
(9 ratings)
-
(0 ratings)
Configurability
-
(0 ratings)
7.3
(3 ratings)
-
(0 ratings)
Ease of integration
-
(0 ratings)
9.0
(1 ratings)
-
(0 ratings)
Product Scalability
-
(0 ratings)
9.1
(2 ratings)
-
(0 ratings)
Vendor post-sale
-
(0 ratings)
8.2
(2 ratings)
-
(0 ratings)
Vendor pre-sale
-
(0 ratings)
8.2
(2 ratings)
-
(0 ratings)
User Testimonials
Akamai CloudTestNew RelicOctoPerf
Likelihood to Recommend
Akamai
We were designing an Airlines reservation system, where we wanted to check the maximum number if reservation our system can handle, this tool helped us to get the test results but the issue was from set up point of view, the initial set up took too much time. But we were able to achieve our Reservation system process.
Read full review
New Relic
New Relic its an excellent tool for monitoring services used on the SAAS universe, like web servers, relational and nosql dbms, reverse proxies, text databases, etc. Its also a powerful tool to monitor resource usage on said servers. However, its not well fitted to monitor custom services - if you need to generate alerts based on logs or database information, for example
Read full review
OctoPerf
We used OctoPerf on Continuous Integrations and Continuous Deployment as part of load testing because it is very easy to load data on various frameworks and a wide range of validations can be done virtually. We can also design bespoke graphics and reports to aid in the validation of testing scenarios.
Read full review
Pros
Akamai
  • Integration Call's like REST
  • Integration Call's like SOAP
  • Performance Testing
  • Load Testing on Load Balancer
Read full review
New Relic
  • It gives us insights of applications, infrastructure, clouds very well.
  • The alerting system in New Relic helps us to easily identify the root cause which reduces the MTTR.
  • It has new features related to AI which helps to troubleshoot any problem in a very short time it gives future predictions also.
Read full review
OctoPerf
  • Infrastructure for the cloud that is automated.
  • We have the ability to build real-time reports and dashboards.
Read full review
Cons
Akamai
  • Report generation is difficult
  • Some graphs are not displaying accurate results
  • More information are missing with respect to load testing
Read full review
New Relic
  • And while powerful, building tailored dashboards with organ-specific metrics (such as energy load variance across regions) can be difficult to navigate. The UI isn't as drag-and-drop easy, and query-based widgets typically involve some trial and error for non-devs.
  • Alerts may be hypersensitive or over general. I We often get a spam of non-critical alerts while doing load testing, all overhauling to me alone and making it difficult to identify actual issues especially in energy systems where spikes are very common.
  • With our expanding fleet of Iot devices, the per-host pricing model is becoming expensive, quickly. More detailed billing based on microservices, or that works at sensor level, would make it more adaptable for energy platforms.
Read full review
OctoPerf
  • The version of the runtime needs be upgraded.
  • Additional features should be included.
Read full review
Likelihood to Renew
Akamai
No answers on this topic
New Relic
The only issue that we have had with New Relic is that the price might be a little expensive for smaller companies. The amount of data you store in New Relic impacts the cost, and can get away from you if you don't work closely with the vendor. Overall though the application is top notch.
Read full review
OctoPerf
No answers on this topic
Usability
Akamai
No answers on this topic
New Relic
I have given this much rating as I am used New Relic in different sectors and for different use cases like its K8s monitoring, infra monitoring, full stack monitoring as compare to other tools New Relic gives data in a formatted and connected way, and also it is giving us value for money. It also launches new features day by day which helps users to track the issue very quickly. It also supports OTel integrations which is the latest trend of observability tools. thats why I had given this much rating to New Relic.
Read full review
OctoPerf
No answers on this topic
Reliability and Availability
Akamai
No answers on this topic
New Relic
Never observed an outage
Read full review
OctoPerf
No answers on this topic
Performance
Akamai
No answers on this topic
New Relic
there are times where browser cache will cause issues that require you to clear your browser before continuing.
Read full review
OctoPerf
No answers on this topic
Support Rating
Akamai
No answers on this topic
New Relic
The support team has been really helpful and resolved most of the issues on time. However, for a couple of issues, several follow-ups were needed to elicit a reasonable response. The issue was deeply technical and could have been investigated only by their Architects, and bringing them into the ticket took longer than needed
Read full review
OctoPerf
No answers on this topic
Implementation Rating
Akamai
No answers on this topic
New Relic
It's better to start by implementing New Relic in one project and test everything. Try to follow best recommended practices and read all the official documentation. Everything seems well tested. Then, start by installing agents to the rest of your projects and keep a close look to all logs and metrics New Relic gives you.
Read full review
OctoPerf
No answers on this topic
Alternatives Considered
Akamai
The bundle of features that other tools provide is much higher when compared to the one provided by Akamai CloudTest, this is something they need to focus on Priority. Most tools comes with default setup and ends to end testing scenario that can be covered, such as Regression testing. From Akamai CloudTest this is a missing features that can be added up soon.
Read full review
New Relic
Data Dog has solutions that look more attractive, but not at their price point. We have also tried to build a solution straight from the Cloud, where our business is built, but some things are too hard to replicate. This shows that New Relic is useful and helps our efficiency.
Read full review
OctoPerf
Unravel Data is a cloud optimization tool, whereas OctoPerf can be used to easily run load test cases and scenarios, as well as develop automated cloud infrastructure to generate customized reports on the test cases run. For the greatest possible user experience, we have some additional functionality such as Jmeter and other legacy tools.
Read full review
Scalability
Akamai
No answers on this topic
New Relic
Agent deployment is easily integrated into our workflow. Adding the agent to new servers is quick and painless
Read full review
OctoPerf
No answers on this topic
Return on Investment
Akamai
  • System Hangs as where severe load testing is required
  • Authentication is an issue when using OAUTH
  • Scalability can be improved and also an on premise tool can be of great help
Read full review
New Relic
  • We were able to quickly identify our most time consuming APIs. In some cases we were able to bring down times for some apis from 4s to 200ms.
  • We were able to identify our slowest database queries and optimize them for quicker response times.
Read full review
OctoPerf
  • There is no need to know how to code.
  • Reports made to order.
Read full review
ScreenShots

OctoPerf Screenshots

Screenshot of the scripting studio in OctoPerf - no code neededScreenshot of the runtime part of the application. Here you can select multiple injection locations and run several scenarios in a single testScreenshot of live reporting with numerous metrics. The report is completely dynamics.