TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    CircleCI

    Score9.3 out of 10
    N/ACircleCI is a software delivery engine from the company of the same name in San Francisco, that helps teams ship software faster, offering their platform for Continuous Integration and Continuous Delivery (CI/CD). Ultimately, the solution helps to map every source of change for software teams, so they can accelerate innovation and growth.

    $0

    for up to 6,000 build minutes and up to 5 active users per month

    TestMu AI (Formerly LambdaTest)

    Score8.9 out of 10
    Mid-Size Companies (51-1,000 employees)
    TestMu AI (formerly LambdaTest) is a full-stack, AI-native quality engineering platform that lets teams plan, author, execute and analyse software quality in one place, across web, mobile and AI applications. Performance and load testing: TestMu AI runs JMeter .jmx plans and Gatling simulations unchanged, at protocol level, on managed cloud load generators that are provisioned for each run across six regions and removed when it ends, so there is no load…

    $19

    per month per user

    Pricing
    CircleCITestMu AI (Formerly LambdaTest)
    Editions & Modules
    Server
    Contact Sales
    Performance
    starting at $15
    per month
    Scale
    starting at $2000
    per month
    Virtual Live
    $19
    per month Parallel Test
    Real Device Plus Live
    $49
    per month 1 parallel test
    Test Manager
    $59
    per month per seat
    Web Automation on Desktop
    $99
    per month Parallel Test
    Virtual Automation Cloud
    $159
    per month Parallel Test
    HyperExecute Cloud (Multi OS)
    $199
    per month Parallel Test
    Real Device + Automation Cloud
    $249
    per month Parallel Test
    SmartUI Visual Regression
    $269
    per month Parallel Test
    Kane AI (Mobile + Web)
    $349
    per month Parallel Test
    Enterprise
    Custom Pricing
    Parallel Test
    HyperExecute On-Premise
    Custom Pricing
    per parallel test
    Offerings
    Pricing Offerings
    CircleCITestMu AI (Formerly LambdaTest)
    Free Trial
    NoYes
    Free/Freemium Version
    YesYes
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details—Discount available for annual pricing.
    More Pricing Information
    Community Pulse
    CircleCITestMu AI (Formerly LambdaTest)
    Considered Both Products
    CircleCI
    No answer on this topic
    TestMu AI
    Chose TestMu AI (Formerly LambdaTest)
    The integration feature makes LambdaTest better. When I researched on some testing tools and compare them, this feature plays a crucial role in getting this selected. We used it for a long time because of its benefits at best rates in the industry.
    Incentivized
    Key User Insights
    Would buy again
    100%
    Would buy again
    8 Answers
    98%
    Would buy again
    105 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    8 Answers
    98%
    Delivers good value for the price
    99 Answers
    Happy with the feature set
    100%
    Happy with the feature set
    8 Answers
    100%
    Happy with the feature set
    107 Answers
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    5 Answers
    97%
    Lived up to sales and marketing promises
    75 Answers
    Implementation went as expected
    100%
    Implementation went as expected
    7 Answers
    97%
    Implementation went as expected
    89 Answers
    Best Alternatives
    CircleCITestMu AI (Formerly LambdaTest)
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    AWS CodePipeline
    Score6.6 out of 10
    No answers on this topic
    Enterprises
    AWS CodePipeline
    Score6.6 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternatives
    User Ratings
    CircleCITestMu AI (Formerly LambdaTest)
    Likelihood to Recommend
    9.0
    (27 ratings)
    9.0
    (118 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    8.7
    (7 ratings)
    Usability
    9.0
    (2 ratings)
    9.1
    (70 ratings)
    Availability
    -
    (0 ratings)
    10.0
    (1 ratings)
    Performance
    7.8
    (3 ratings)
    9.0
    (1 ratings)
    Support Rating
    6.9
    (6 ratings)
    10.0
    (7 ratings)
    Implementation Rating
    -
    (0 ratings)
    9.0
    (2 ratings)
    Configurability
    -
    (0 ratings)
    8.0
    (1 ratings)
    Contract Terms and Pricing Model
    -
    (0 ratings)
    9.0
    (1 ratings)
    Ease of integration
    -
    (0 ratings)
    10.0
    (1 ratings)
    Product Scalability
    -
    (0 ratings)
    10.0
    (1 ratings)
    Vendor post-sale
    -
    (0 ratings)
    9.0
    (1 ratings)
    Vendor pre-sale
    -
    (0 ratings)
    9.0
    (1 ratings)
    User Testimonials
    CircleCITestMu AI (Formerly LambdaTest)
    Likelihood to Recommend
    CircleCI
    Based on our experience, CircleCI is well-suited for automating mobile app release cycles. For example, to release an iOS app, you would need to build, sign, and upload it to TestFlight, which requires a dedicated Mac in the office. But with CircleCI, you can have macOS executors, so you don't have to manage a physical build machine. Another benefit is that CircleCI's certified AWS Orbs abstract away complex authentication and deployment logic, allowing us to build, push, and deploy Docker containers to Amazon ECS with minimal configuration and high reliability. CircleCI is less suited for smaller projects where the development and deployment are not that extensive, for example, a static site. Once you have built a static site, you probably won't make any further changes, so there's no point in paying for it.
    Incentivized
    Read full review
    TestMu AI
    One day, I needed to test a specific issue that was occurring only on Pixel phones. I turned to LambdaTest, quickly identified the problem, and was able to fix it. There hasn't been a situation where I felt LambdaTest didn't help, it's my go-to solution for testing, as it solves many problems.
    Incentivized
    Read full review
    Pros
    CircleCI
    • Automated builds! This is really why you get CircleCI, to automate the build process. This makes building your application far more reliable and repeatable. It can also run tests and verify your application is working as expected.
    • Simple. Unlike Jenkins, Teamcity, or other platforms, CircleCI doesn't need a lot of setup. It's completely hosted, so there's no infrastructure to set up. The config file does take a bit to understand, but if you follow their example and start with something small and add to it, you can get it up and going quicker than it first looks.
    • Scales easily. Again, since it's all cloud-based, you don't have to manage or scale infrastructure. Simply subscribe to the number of containers you want, and scaling up just means buying more containers.
    Incentivized
    Read full review
    TestMu AI
    • Very accessible as multiple users can be added in each subscription
    • Very reliable as it is very close to the actual device when it comes to operating system and version behavior
    • There are a lot of options for devices and browsers that users can choose from when it comes to emulating and testing
    Read full review
    Cons
    CircleCI
    • While configuration is easy, the config files can get very very long.
    • Price compared to some alternatives that are cheaper / free. Especially so if you are running multiple containers in parallel.
    • Have experienced numerous outages (3-5) in the last few months where CircleCI has been down.
    • Web documentation and tutorials haven't been as good as some of the competitors.
    Incentivized
    Read full review
    TestMu AI
    • More real devices should be added like I have Samsung mobile but it was not in the list
    • It takes time in checking the link on LambdaTest if we compare with real mobiles
    • Sometimes exact results are not matching as from real mobiles
    Read full review
    Likelihood to Renew
    CircleCI
    No answers on this topic
    TestMu AI
    The reason i have given the 10 points becasue the problem LambdaTest solves is providing access to all devices in one place, allowing developers to identify the same errors they would encounter on real devices. This makes life much easier, especially for developers who regularly face cross-device functionality issues. It's a big plus point that positions LambdaTest as an all-in-one solution.
    Incentivized
    Read full review
    Usability
    CircleCI
    The reliability & speed, it just works. The ability to spin up macOS runners and Docker containers on demand without managing hardware is a huge win. The Orbs system makes integrating with AWS and Slack incredibly easy, saving us weeks of custom scripting and providing real-time updates in our Slack channel. This makes it easy for us to track and ensures that everyone involved knows the status. Of course, it has drawbacks related to configuration complexity and, in some cases, cost transparency, but overall, it is an industry-standard, robust tool that solves our core infrastructure problems well.
    Incentivized
    Read full review
    TestMu AI
    Because of the ease of use of the platform, we just save a lot of time and effort with this as its a feature rich solution, we just need to upload app binary once and for everytime we need to test on a different device we can just directly install that binary on the device without the pain of reupload.
    Read full review
    Reliability and Availability
    CircleCI
    No answers on this topic
    TestMu AI
    yes always available
    Incentivized
    Read full review
    Performance
    CircleCI
    It's pretty snappy, even with using workflows with multiple steps and different docker images. I've seen builds take a long time if it's really involved, but from what I can tell, it's still at least on par if not faster than other build tools.
    Incentivized
    Read full review
    TestMu AI
    haven't found any glitch while using this
    Incentivized
    Read full review
    Support Rating
    CircleCI
    Unless you have a reasonably large account, you're going to be mainly stuck reading their documentation. Which has improved somewhat over the years but is still extremely limited compared to a platform like Digital Ocean who invested in the documentation and a community to ensure it's kept up to date. If you can't find your answer there, you can be stuck.
    Incentivized
    Read full review
    TestMu AI
    The customer support team is very active and cooperative. Once, I contacted them in their off timings because of an issue, I got an instant reply from the executive and he resolved the issue very efficiently. This is why we have been using LambdaTest for more than two years. It is best suited for us.
    Read full review
    Implementation Rating
    CircleCI
    No answers on this topic
    TestMu AI
    Implementation of Lambdatest was very easy for different project requirements.
    Incentivized
    Read full review
    Alternatives Considered
    CircleCI
    Jenkins is usually self-hosted, Travis CI's infrastructure is largely unreliable (lots of tests time out for no discernable reason), and Semaphore encourages you to configure your CI/CD from a web UI. We like CircleCI because its hosted, our tests run largely as expected on their infrastructure, and we can configure it from a config file that we track in GitHub.
    Incentivized
    Read full review
    TestMu AI
    While BrowserStack is also a well-established platform, we found LambdaTest to offer similar and even better features at reasonable pricing. LambdaTest is more cost-effective than BrowserStack. LambdaTest provides a free forever plan, while BrowserStack does not. Even manual testing plans are better priced than BrowserStack’s. In terms of UI and onboarding, we found LambdaTest more user-friendly as well.
    Read full review
    Scalability
    CircleCI
    No answers on this topic
    TestMu AI
    not all department, but we're using for our clients
    Incentivized
    Read full review
    Return on Investment
    CircleCI
    • We pay over $5K/ month and we have high expectations for service. Sometimes I feel that we don't get the value, but only sometimes.
    • We have had to build our own application to keep state and broker releases and deployments. We call our app deployer. I feel that CircleCI could do more to understand our needs and possibly build additional features that would enable us to invest less in build and deployment infrastructure and justify paying more for Circle.
    Incentivized
    Read full review
    TestMu AI
    • Automation testing has a bit of a learning curve
    • Lack of real device keep that bug in your head if not on the website.
    • Need to wait for a while for a new OS or browser version on the contrary of immediate availability in case of owning a lab
    Read full review
    ScreenShots

    TestMu AI (Formerly LambdaTest) Screenshots

    Screenshot of An automated screenshot.Screenshot of Mobile-browser-testingScreenshot of Automation testing on LambdatestScreenshot of Some of the available integrations.Screenshot of Real-time testingScreenshot of Responsive testing