TrustRadius: an HG Insights company

IBM Engineering Lifecycle Management vs. CucumberStudio, from SmartBear

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    IBM Engineering Lifecycle Management

    Score5 out of 10
    N/AIBM Engineering Lifecycle Management (ELM) is an integrated suite for managing requirements, engineering work, system and software models, and verification activities across complex product-development programs. It is used by systems engineers, software teams, test organizations, project managers, and compliance teams in industries such as automotive, aerospace and defense, medical devices, and public infrastructure.N/A

    CucumberStudio

    Score4.9 out of 10
    N/ACucumberStudio, now a SmartBear product since the 2019 acquisition, is a continuous testing platform replacing the former HipTest, supporting agile development with manual and automated code testing, reusable steps, feature history with living documentation, among other features.N/A
    Pricing
    IBM Engineering Lifecycle ManagementCucumberStudio
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    IBM Engineering Lifecycle ManagementCucumberStudio
    Free Trial
    NoNo
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    IBM Engineering Lifecycle ManagementCucumberStudio
    Considered Both Products
    IBM
    No answer on this topic
    SmartBear
    No answer on this topic
    Key User Insights
    Would buy again
    78%
    Would buy again
    7 Answers
    No answers on this topic
    Delivers good value for the price
    88%
    Delivers good value for the price
    7 Answers
    No answers on this topic
    Happy with the feature set
    89%
    Happy with the feature set
    8 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    5 Answers
    No answers on this topic
    Implementation went as expected
    86%
    Implementation went as expected
    6 Answers
    No answers on this topic
    Best Alternatives
    IBM Engineering Lifecycle ManagementCucumberStudio
    Small Businesses
    Polarion ALM
    Score10 out of 10
    monday dev
    Score9.4 out of 10
    Medium-sized Companies
    PTC Windchill RV&S
    Score2 out of 10
    Planview AgilePlace
    Score7.6 out of 10
    Enterprises
    Polarion ALM
    Score10 out of 10
    Planview AgilePlace
    Score7.6 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    IBM Engineering Lifecycle ManagementCucumberStudio
    Likelihood to Recommend
    3.0
    (22 ratings)
    9.0
    (1 ratings)
    Likelihood to Renew
    8.0
    (6 ratings)
    -
    (0 ratings)
    Usability
    4.0
    (5 ratings)
    -
    (0 ratings)
    Support Rating
    5.0
    (3 ratings)
    9.0
    (1 ratings)
    Implementation Rating
    10.0
    (1 ratings)
    -
    (0 ratings)
    User Testimonials
    IBM Engineering Lifecycle ManagementCucumberStudio
    Likelihood to Recommend
    IBM
    The software is robust enough to handle highly complex software development or other product development and can be used well beyond the range to do what a client needs. However, because of the inability to hold its users to proper best practices, things can get wildly out of hand and cascade over the years, creating unnecessary technical debt. The system has a lot of usable features, but they don't funnel users toward the correct processes and practices.
    Incentivized
    Read full review
    SmartBear
    HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.
    Incentivized
    Read full review
    Pros
    IBM
    • Open Services supporting Lifecycle Collaboration (OSLC).
    • Required definition management and managed capabilities enabling.
    • Rational DOORS Web Access for local on the test field presence.
    • On-sites established reporting system.
    • Approved linking requirements to test plans
    • Engineering Requirements Management DOORS traces requirements thereby eliminates manually processes and spreadsheets, for improved productivity.
    • Returns the investment efficiently.
    Incentivized
    Read full review
    SmartBear
    • Good integration with Jira
    • Includes integration with different tools for different porpuses
    • You can build your own framework to automate scenarios and make it work with Hiptest
    Incentivized
    Read full review
    Cons
    IBM
    • I feel like it is too heavy sometimes and updating is not very straight forward. For example, if I want to change an incident ticket (IN) to a service request (SR) and add some comment for the change, I have to first change the IN to SR, then click refresh which takes a few seconds, then add a comment. If I forget the refresh step, my comment will be discarded without warning like my ticket is not in the latest status. This also happens when somebody else changes the ticket during my edit as I can not lock the ticket exclusively.
    Incentivized
    Read full review
    SmartBear
    • UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
    • To get extra functionalities you have to pay for them separately.
    Incentivized
    Read full review
    Likelihood to Renew
    IBM
    At the moment we are required by contract to continue to use the IBM DOORS software for our current client. Given that it can be expensive, if we were to use it after our current client's needs were met, we would have to secure other projects in order to justify the continued use of the software.
    Incentivized
    Read full review
    SmartBear
    No answers on this topic
    Usability
    IBM
    The UI is terrible and not intuitive. Users need training in order to complete tasks. Much like SAP, it's not the clearest tool. The tracing feature is especially complicated because you must write the scripts yourself. There is a learning curve. Also, even the setup, installation, and logging in each time takes a considerable amount of time.
    Incentivized
    Read full review
    SmartBear
    No answers on this topic
    Support Rating
    IBM
    It does a basic job and has the potential to complete some robust reporting tasks, however, it really is a clunky piece of software with a terrible user interface that makes using it routinely quite unpleasant. Many of our legacy and maintenance projects still use DOORS but our department and company use many alternatives and are looking for better tools.
    Incentivized
    Read full review
    SmartBear
    The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.
    Incentivized
    Read full review
    Implementation Rating
    IBM
    No problems
    Incentivized
    Read full review
    SmartBear
    No answers on this topic
    Alternatives Considered
    IBM
    It was easier to do all the change management-related activities, even configurations were handled very effectively. New process definitions and initiatives made it easier for better project deliverables. Effective resource allocations and better reporting and defect management. The overall cost of the tool is great too and well within budget.
    Incentivized
    Read full review
    SmartBear
    No answers on this topic
    Return on Investment
    IBM
    • It's part of CLM suite so it can be used to manage the whole lifecycle with tight integration with development module (Rational Team Concert) and quality module (Rational Quality Manager).
    • Comprehensive reports and dashboards provide better visibility.
    • License cost is on higher side.
    Incentivized
    Read full review
    SmartBear
    • It helps to have organization in our scenarios.
    • It helps to get regressions done faster than doing it manually
    • It helps to graphically see the progress and results of executions.
    Incentivized
    Read full review
    ScreenShots

    CucumberStudio Screenshots

    Screenshot of CucumberStudio empowers the whole team to read and refine executable specifications without needing technical tools. Business and technology teams can collaborate on acceptance criteria and bridge their gap.