TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    CircleCI

    Score9.3 out of 10
    N/ACircleCI is a software delivery engine from the company of the same name in San Francisco, that helps teams ship software faster, offering their platform for Continuous Integration and Continuous Delivery (CI/CD). Ultimately, the solution helps to map every source of change for software teams, so they can accelerate innovation and growth.

    $0

    for up to 6,000 build minutes and up to 5 active users per month

    ReadyAPI

    Score6.1 out of 10
    N/AReadyAPI (formerly SoapUI Pro, LoadUI Pro, and ServiceV Pro) is a REST and SOAP API functional testing tool that enables software developers, QA engineers, and manual testers to work together to create, maintain, and execute complex end-to-end API tests in their CI/CD pipelines without needing to code.N/A
    Pricing
    CircleCIReadyAPI
    Editions & Modules
    Server
    Contact Sales
    Performance
    starting at $15
    per month
    Scale
    starting at $2000
    per month
    No answers on this topic
    Offerings
    Pricing Offerings
    CircleCIReadyAPI
    Free Trial
    NoYes
    Free/Freemium Version
    YesYes
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    CircleCIReadyAPI
    Considered Both Products
    CircleCI
    No answer on this topic
    SmartBear
    No answer on this topic
    Key User Insights
    Would buy again
    100%
    Would buy again
    8 Answers
    93%
    Would buy again
    28 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    8 Answers
    89%
    Delivers good value for the price
    24 Answers
    Happy with the feature set
    100%
    Happy with the feature set
    8 Answers
    97%
    Happy with the feature set
    29 Answers
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    5 Answers
    94%
    Lived up to sales and marketing promises
    15 Answers
    Implementation went as expected
    100%
    Implementation went as expected
    7 Answers
    92%
    Implementation went as expected
    22 Answers
    Best Alternatives
    CircleCIReadyAPI
    Small Businesses
    No answers on this topic
    TestComplete
    Score8 out of 10
    Medium-sized Companies
    AWS CodePipeline
    Score6.6 out of 10
    OpenText UFT One
    Score8 out of 10
    Enterprises
    AWS CodePipeline
    Score6.6 out of 10
    SoapUI Open Source
    Score8.3 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    CircleCIReadyAPI
    Likelihood to Recommend
    9.0
    (27 ratings)
    7.0
    (65 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    7.3
    (18 ratings)
    Usability
    9.0
    (2 ratings)
    9.9
    (3 ratings)
    Availability
    -
    (0 ratings)
    9.0
    (1 ratings)
    Performance
    7.8
    (3 ratings)
    8.0
    (1 ratings)
    Support Rating
    6.9
    (6 ratings)
    8.0
    (6 ratings)
    Implementation Rating
    -
    (0 ratings)
    7.0
    (1 ratings)
    Product Scalability
    -
    (0 ratings)
    7.0
    (1 ratings)
    User Testimonials
    CircleCIReadyAPI
    Likelihood to Recommend
    CircleCI
    Based on our experience, CircleCI is well-suited for automating mobile app release cycles. For example, to release an iOS app, you would need to build, sign, and upload it to TestFlight, which requires a dedicated Mac in the office. But with CircleCI, you can have macOS executors, so you don't have to manage a physical build machine. Another benefit is that CircleCI's certified AWS Orbs abstract away complex authentication and deployment logic, allowing us to build, push, and deploy Docker containers to Amazon ECS with minimal configuration and high reliability. CircleCI is less suited for smaller projects where the development and deployment are not that extensive, for example, a static site. Once you have built a static site, you probably won't make any further changes, so there's no point in paying for it.
    Incentivized
    Read full review
    SmartBear
    As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.
    Incentivized
    Read full review
    Pros
    CircleCI
    • Automated builds! This is really why you get CircleCI, to automate the build process. This makes building your application far more reliable and repeatable. It can also run tests and verify your application is working as expected.
    • Simple. Unlike Jenkins, Teamcity, or other platforms, CircleCI doesn't need a lot of setup. It's completely hosted, so there's no infrastructure to set up. The config file does take a bit to understand, but if you follow their example and start with something small and add to it, you can get it up and going quicker than it first looks.
    • Scales easily. Again, since it's all cloud-based, you don't have to manage or scale infrastructure. Simply subscribe to the number of containers you want, and scaling up just means buying more containers.
    Incentivized
    Read full review
    SmartBear
    • Ease of use (ability to automatically import API definitions, Jenkins integration for running in the pipeline).
    • Detailed test reports (allow to easily identify weak spots during both functional and performance testing).
    • One platform for all tests (allows to closely couple and reuse existent tests).
    Incentivized
    Read full review
    Cons
    CircleCI
    • While configuration is easy, the config files can get very very long.
    • Price compared to some alternatives that are cheaper / free. Especially so if you are running multiple containers in parallel.
    • Have experienced numerous outages (3-5) in the last few months where CircleCI has been down.
    • Web documentation and tutorials haven't been as good as some of the competitors.
    Incentivized
    Read full review
    SmartBear
    • Needs good documentation
    • Need to improve the performance of the tool
    • Setup is very complex and for such [a] commercial tool, it should easy and straightforward
    • Tool says it supports security testing but in reality, it is not at an extensive level.
    Incentivized
    Read full review
    Likelihood to Renew
    CircleCI
    No answers on this topic
    SmartBear
    The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.
    Incentivized
    Read full review
    Usability
    CircleCI
    The reliability & speed, it just works. The ability to spin up macOS runners and Docker containers on demand without managing hardware is a huge win. The Orbs system makes integrating with AWS and Slack incredibly easy, saving us weeks of custom scripting and providing real-time updates in our Slack channel. This makes it easy for us to track and ensures that everyone involved knows the status. Of course, it has drawbacks related to configuration complexity and, in some cases, cost transparency, but overall, it is an industry-standard, robust tool that solves our core infrastructure problems well.
    Incentivized
    Read full review
    SmartBear
    SoapUI allows us to combine multiple tests and adhere
    to the sequence that they need to run in order to complete successfully.
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing
    Read full review
    Reliability and Availability
    CircleCI
    No answers on this topic
    SmartBear
    Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
    Read full review
    Performance
    CircleCI
    It's pretty snappy, even with using workflows with multiple steps and different docker images. I've seen builds take a long time if it's really involved, but from what I can tell, it's still at least on par if not faster than other build tools.
    Incentivized
    Read full review
    SmartBear
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing.
    Read full review
    Support Rating
    CircleCI
    Unless you have a reasonably large account, you're going to be mainly stuck reading their documentation. Which has improved somewhat over the years but is still extremely limited compared to a platform like Digital Ocean who invested in the documentation and a community to ensure it's kept up to date. If you can't find your answer there, you can be stuck.
    Incentivized
    Read full review
    SmartBear
    To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP
    Incentivized
    Read full review
    Implementation Rating
    CircleCI
    No answers on this topic
    SmartBear
    no very easy but lacks documentation
    Read full review
    Alternatives Considered
    CircleCI
    Jenkins is usually self-hosted, Travis CI's infrastructure is largely unreliable (lots of tests time out for no discernable reason), and Semaphore encourages you to configure your CI/CD from a web UI. We like CircleCI because its hosted, our tests run largely as expected on their infrastructure, and we can configure it from a config file that we track in GitHub.
    Incentivized
    Read full review
    SmartBear
    ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.
    Incentivized
    Read full review
    Scalability
    CircleCI
    No answers on this topic
    SmartBear
    It has an excellent GUI design and the reporting mechanism is also very
    good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
    Read full review
    Return on Investment
    CircleCI
    • We pay over $5K/ month and we have high expectations for service. Sometimes I feel that we don't get the value, but only sometimes.
    • We have had to build our own application to keep state and broker releases and deployments. We call our app deployer. I feel that CircleCI could do more to understand our needs and possibly build additional features that would enable us to invest less in build and deployment infrastructure and justify paying more for Circle.
    Incentivized
    Read full review
    SmartBear
    • Very quick regression testing, hence having the testing results very soon, even the same day of deployment
    • for same above reason, it can save money for corporation (so no tedious, costly and erroneous manual testings)
    • The test reports are compatible with TestNG, so the corporation can integrate the reports in our Autamation frameworks such as Allure or Jira Zephyr
    Incentivized
    Read full review
    ScreenShots