AWS Device Farm
8 Ratings
BlazeMeter Continuous Testing Platform
19 Ratings

AWS Device Farm

8 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 10 out of 100

Based on 8 reviews and ratings

BlazeMeter Continuous Testing Platform

19 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.2 out of 100

Based on 19 reviews and ratings

Likelihood to Recommend

AWS Device Farm

This is the best solution I have found to trail run software before it is deployed across a large number of users and a large variety of device types. We have Windows, Mac OS, Android, and iOS devices. Android alone has a ton of OSs. This helps save time and test functionality across the board.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 2 answers on this topic

BlazeMeter Continuous Testing Platform

It is good for measurements of performance testing. It can be used to run API testing.I can not use this for monitoring but it can be used as a complement for monitoring tools (like Catchpoint or New Relic). It can help to produce load on your site and monitor.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 4 answers on this topic

Pros

AWS Device Farm

  • 100% compatibility with the installed user base. No simulation, but real results.
  • Integration with Jenkins and other CI/CD tools.
  • A considerable amount of device types available. Again, real devices in the cloud!

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 2 answers on this topic

BlazeMeter Continuous Testing Platform

  • BlazeMeter takes the .jmx script that teams had written for JMeter. The transition from JMeter to BlazeMeter was seamless.
  • BlazeMeter offers its own cloud and hence we did not have to set it up on-premise.
  • BlazeMeter hits our application from various geographic locations that simulates real life users.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 4 answers on this topic

Cons

AWS Device Farm

  • Cost and price is always a concern
  • Can be a bit clunky for the staff using the service.
  • Sometimes, misses issues with iOS devices.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 2 answers on this topic

BlazeMeter Continuous Testing Platform

  • Blazemeter reporting is very basic and shallow. There is no way to drill down or correlate. I can get better reports by using JMeter for free.
  • Blazemeter is very costly. Testing with volumes of more than 1K cu is expensive, and can be done for much cheaper if a company/team is willing to invest a bit of time to figure out how to use cloud instances and jmeter slaves, and to write a basic script to collect resulting xml output.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 4 answers on this topic

Usability

AWS Device Farm

AWS Device Farm 10.0
Based on 1 answer
The users have no issue. The IT staff have learned to work with the software with the help of AWS support. I find it very effective. Could it be easier? Of course. That doesn't mean this isn't a great solution. I would recommend it to anyone based on usability. Overall, it is easy enough to use.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 1 answers on this topic

BlazeMeter Continuous Testing Platform

No score
No answers yet
No answers on this topic

Support Rating

AWS Device Farm

AWS Device Farm 10.0
Based on 3 answers
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 3 answers on this topic

BlazeMeter Continuous Testing Platform

No score
No answers yet
No answers on this topic

Alternatives Considered

AWS Device Farm

This is the only solution I have used from device farming. From that perspective, I would purchase it again. I think this is a great solution for a large, diverse organization looking to mass deploy and manage software and devices. We selected this software because we have had great luck with other AWS services.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 2 answers on this topic

BlazeMeter Continuous Testing Platform

We are still evaluating in [the] current org.Old scripts can't be fully migrated to JMeter BlazeMeter

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 4 answers on this topic

Return on Investment

AWS Device Farm

  • Reduced the amount we spent on physical devices by > 90%.
  • Enabled real CI integration even when running E2E test scripts using mobile phones.
  • Helped us to improve overall App stability and rating - fewer crashes (80% to 99% of sessions crashless) and 75% rating increases on apps.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 2 answers on this topic

BlazeMeter Continuous Testing Platform

  • We have detected performance breaks in our app during early stages and avoided to take this problems into production.
  • We have been able to test our APIs and have a measurement of the performance.

Read full review

Anonymous | TrustRadius Reviewer
Verified User
View all 4 answers on this topic

Pricing Details

AWS Device Farm

General

Free Trial
—
Free/Freemium Version
—
Premium Consulting/Integration Services
—
Entry-level set up fee?
No

AWS Device Farm Editions & Modules

Edition
Pay-As-You-Go$0.171
Unlimited Testing$250.002
Private Devices$200.002
Pay as You Go - Desktop Browsers$0.0053
  1. per device minute
  2. per month
  3. per instance minute
Additional Pricing Details
—

BlazeMeter Continuous Testing Platform

General

Free Trial
—
Free/Freemium Version
Yes
Premium Consulting/Integration Services
—
Entry-level set up fee?
No

BlazeMeter Continuous Testing Platform Editions & Modules

Edition
Basic$149.001
Pro$649.001
  1. Per Month
Additional Pricing Details
—

Add comparison