What users are saying about
11 Ratings
3 Ratings
11 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 9 out of 100
3 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 6.9 out of 100

Feature Set Ratings

    Load Testing

    AWS Device Farm

    Feature Set Not Supported
    N/A
    8.0

    k6

    80%
    k6 ranks higher in 3/3 features

    End to end performance management

    N/A
    0 Ratings
    8.0
    80%
    1 Rating

    Real time monitoring

    N/A
    0 Ratings
    8.0
    80%
    1 Rating

    Automated anomaly detection

    N/A
    0 Ratings
    8.0
    80%
    1 Rating

    Attribute Ratings

    • AWS Device Farm is rated higher in 1 area: Likelihood to Recommend

    Likelihood to Recommend

    9.3

    AWS Device Farm

    93%
    4 Ratings
    8.0

    k6

    80%
    1 Rating

    Support Rating

    10.0

    AWS Device Farm

    100%
    2 Ratings

    k6

    N/A
    0 Ratings

    Likelihood to Recommend

    Amazon AWS

    AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.
    Read full review

    Grafana Labs

    [k6 (formerly Load Impact)] is well suited to run performance automated suites and to run stress tests, spike tests and load tests[.] We can run tests from recorded [sessions] but we cannot run npm modules and we cannot run nod js libs[.]
    Read full review

    Pros

    Amazon AWS

    • Integration with CI/CD Pipeline
    • Diversity in Real Devices over the Cloud
    • Pay as you go option
    • Reproduce Issues and easily collect all kinds of logs
    Read full review

    Grafana Labs

    • Load testing
    • Stress testing
    • Performance testing
    • Spike testing
    Read full review

    Cons

    Amazon AWS

    • Interface (CLI) not very easy. Competition has better options.
    • Integration with IDE for test case coding.
    • Reporting for the test scripts executed.
    Read full review

    Grafana Labs

    • I would like to see k6 run in browsers
    • I would like to be able to import npm modules
    • I would like to see k6 has a GUI
    Read full review

    Pricing Details

    AWS Device Farm

    Starting Price

    $0.005 per instance minute

    Editions & Modules

    AWS Device Farm editions and modules pricing
    EditionModules
    Pay-As-You-Go$0.171
    Unlimited Testing$250.002
    Private Devices$200.003
    Pay as You Go - Desktop Browsers$0.0054

    Footnotes

    1. per device minute
    2. per month
    3. per month
    4. per instance minute

    Offerings

    Free Trial
    Free/Freemium Version
    Premium Consulting/Integration Services

    Entry-level set up fee?

    No setup fee

    Additional Details

    k6

    Starting Price

    $59 per month

    Editions & Modules

    k6 editions and modules pricing
    EditionModules
    Developer591
    Team3392
    Pro11993
    Custom & EnterpriseContact Sales4

    Footnotes

    1. per month (annual plan)
    2. per month (annual plan)
    3. per month (annual plan)
    4. none

    Offerings

    Free Trial
    Free/Freemium Version
    Premium Consulting/Integration Services

    Entry-level set up fee?

    No setup fee

    Additional Details

    Support Rating

    Amazon AWS

    We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
    Read full review

    Grafana Labs

    No answers on this topic

    Alternatives Considered

    Amazon AWS

    I got more features and handy within AWS Device farm than AWS Cloud9
    Read full review

    Grafana Labs

    No answers on this topic

    Return on Investment

    Amazon AWS

    • Quicker testing leads to faster product to market times
    • Can deploy updates much more regularly by testing across many devices quickly
    Read full review

    Grafana Labs

    • K6 make its easy to engage Devs in testing
    • Extremely fast installation make it count for us
    • Not using all system resources is a great benefit
    Read full review

    Add comparison