TrustRadius: an HG Insights company

IBM Engineering Lifecycle Management vs. Sauce Labs

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    IBM Engineering Lifecycle Management

    Score5 out of 10
    N/AIBM Engineering Lifecycle Management (ELM) is an integrated suite for managing requirements, engineering work, system and software models, and verification activities across complex product-development programs. It is used by systems engineers, software teams, test organizations, project managers, and compliance teams in industries such as automotive, aerospace and defense, medical devices, and public infrastructure.N/A

    Sauce Labs

    Score6.8 out of 10
    N/ASauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired…

    $19

    per month

    Pricing
    IBM Engineering Lifecycle ManagementSauce Labs
    Editions & Modules
    No answers on this topic
    Live Testing
    $19.00
    per month
    Virtual Cloud
    $149.00
    per month
    Offerings
    Pricing Offerings
    IBM Engineering Lifecycle ManagementSauce Labs
    Free Trial
    NoYes
    Free/Freemium Version
    NoYes
    Premium Consulting/Integration Services
    NoYes
    Entry-level Setup FeeNo setup feeOptional
    Additional Details—Free service available for Open Source projects.
    More Pricing Information
    Community Pulse
    IBM Engineering Lifecycle ManagementSauce Labs
    Considered Both Products
    IBM
    No answer on this topic
    Sauce Labs
    No answer on this topic
    Key User Insights
    Would buy again
    78%
    Would buy again
    7 Answers
    90%
    Would buy again
    19 Answers
    Delivers good value for the price
    88%
    Delivers good value for the price
    7 Answers
    100%
    Delivers good value for the price
    19 Answers
    Happy with the feature set
    89%
    Happy with the feature set
    8 Answers
    95%
    Happy with the feature set
    20 Answers
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    5 Answers
    100%
    Lived up to sales and marketing promises
    11 Answers
    Implementation went as expected
    86%
    Implementation went as expected
    6 Answers
    90%
    Implementation went as expected
    18 Answers
    Best Alternatives
    IBM Engineering Lifecycle ManagementSauce Labs
    Small Businesses
    Polarion ALM
    Score10 out of 10
    TestComplete
    Score8 out of 10
    Medium-sized Companies
    PTC Windchill RV&S
    Score2 out of 10
    OpenText UFT One
    Score8 out of 10
    Enterprises
    Polarion ALM
    Score10 out of 10
    SoapUI Open Source
    Score8.3 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    IBM Engineering Lifecycle ManagementSauce Labs
    Likelihood to Recommend
    3.0
    (22 ratings)
    5.6
    (158 ratings)
    Likelihood to Renew
    8.0
    (6 ratings)
    9.3
    (20 ratings)
    Usability
    4.0
    (5 ratings)
    8.4
    (20 ratings)
    Availability
    -
    (0 ratings)
    10.0
    (4 ratings)
    Performance
    -
    (0 ratings)
    8.0
    (4 ratings)
    Support Rating
    5.0
    (3 ratings)
    8.3
    (15 ratings)
    Implementation Rating
    10.0
    (1 ratings)
    7.5
    (6 ratings)
    Configurability
    -
    (0 ratings)
    8.2
    (3 ratings)
    Ease of integration
    -
    (0 ratings)
    9.1
    (2 ratings)
    Product Scalability
    -
    (0 ratings)
    10.0
    (4 ratings)
    Vendor post-sale
    -
    (0 ratings)
    9.0
    (4 ratings)
    Vendor pre-sale
    -
    (0 ratings)
    9.0
    (4 ratings)
    User Testimonials
    IBM Engineering Lifecycle ManagementSauce Labs
    Likelihood to Recommend
    IBM
    The software is robust enough to handle highly complex software development or other product development and can be used well beyond the range to do what a client needs. However, because of the inability to hold its users to proper best practices, things can get wildly out of hand and cascade over the years, creating unnecessary technical debt. The system has a lot of usable features, but they don't funnel users toward the correct processes and practices.
    Incentivized
    Read full review
    Sauce Labs
    Having used some of the competitor's tools over the year I would say that SauceLabs provides a lot of value for money if you plan to run long sets of tests with high frequencies. Paying for a single slot means you can run tests whenever you want without creeping costs but it does make running tests in parallel require an extra slot. Currently, our test suite takes over three hours to run and at the moment it is cost prohibitive to purchase an extra slot. However, having access to live testing and integration with Appium is great.
    Incentivized
    Read full review
    Pros
    IBM
    • Open Services supporting Lifecycle Collaboration (OSLC).
    • Required definition management and managed capabilities enabling.
    • Rational DOORS Web Access for local on the test field presence.
    • On-sites established reporting system.
    • Approved linking requirements to test plans
    • Engineering Requirements Management DOORS traces requirements thereby eliminates manually processes and spreadsheets, for improved productivity.
    • Returns the investment efficiently.
    Incentivized
    Read full review
    Sauce Labs
    • Provides a comprehensive selection of browser and platform versions for test automation and CI/CD pipeline support
    • Provides a rich selection of browser/platform availability for customer issue reproduction
    • Provides a comprehensive set of virtual mobile device configurations for automation and availability
    • Sauce Labs' SaaS and self service tools work and perform well
    Incentivized
    Read full review
    Cons
    IBM
    • I feel like it is too heavy sometimes and updating is not very straight forward. For example, if I want to change an incident ticket (IN) to a service request (SR) and add some comment for the change, I have to first change the IN to SR, then click refresh which takes a few seconds, then add a comment. If I forget the refresh step, my comment will be discarded without warning like my ticket is not in the latest status. This also happens when somebody else changes the ticket during my edit as I can not lock the ticket exclusively.
    Incentivized
    Read full review
    Sauce Labs
    • I've had four changes in account managers over the past couple of years. They ranged from super experienced/advocate to some that seems relatively junior/a bit removed. I understand this happens but clarity on what I can expect with these partnerships would be valuable. What I've gotten in the end has varied dramatically.
    Incentivized
    Read full review
    Likelihood to Renew
    IBM
    At the moment we are required by contract to continue to use the IBM DOORS software for our current client. Given that it can be expensive, if we were to use it after our current client's needs were met, we would have to secure other projects in order to justify the continued use of the software.
    Incentivized
    Read full review
    Sauce Labs
    As we currently know, there's nothing on the market with a big feature set like saucelabs at their current price point. Along with the business not having to learn a whole new tool to use again and the ability to refresh our private devices and the continuously growing number of public devices available and features.
    Incentivized
    Read full review
    Usability
    IBM
    The UI is terrible and not intuitive. Users need training in order to complete tasks. Much like SAP, it's not the clearest tool. The tracing feature is especially complicated because you must write the scripts yourself. There is a learning curve. Also, even the setup, installation, and logging in each time takes a considerable amount of time.
    Incentivized
    Read full review
    Sauce Labs
    It is an incredibly easy service to use for what its primary intention is. The only reason a point is deducted is because more feature enrichment can be done around the Sauce Connect Proxy utility and the Jenkins Sauce OnDemand plugin. User Account administration also needs more work, such as the addition of user groups, rather than a simple hierarchy of users.
    Incentivized
    Read full review
    Reliability and Availability
    IBM
    No answers on this topic
    Sauce Labs
    Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.
    Incentivized
    Read full review
    Performance
    IBM
    No answers on this topic
    Sauce Labs
    The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.
    Incentivized
    Read full review
    Support Rating
    IBM
    It does a basic job and has the potential to complete some robust reporting tasks, however, it really is a clunky piece of software with a terrible user interface that makes using it routinely quite unpleasant. Many of our legacy and maintenance projects still use DOORS but our department and company use many alternatives and are looking for better tools.
    Incentivized
    Read full review
    Sauce Labs
    The people here are just so friendly and personable. For instance, Tristan Lombard answered every single email with a very cheery tone and not only did he diagnose my issue, he also made sure to ask how my day was going. Keep it up
    Incentivized
    Read full review
    Implementation Rating
    IBM
    No problems
    Incentivized
    Read full review
    Sauce Labs
    I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started
    Read full review
    Alternatives Considered
    IBM
    It was easier to do all the change management-related activities, even configurations were handled very effectively. New process definitions and initiatives made it easier for better project deliverables. Effective resource allocations and better reporting and defect management. The overall cost of the tool is great too and well within budget.
    Incentivized
    Read full review
    Sauce Labs
    We have also tested out Browser Stack, which at the time was more geared towards manual testing. Although it appeared to support more mobile devices/browsers, we also wanted something that can plugin in easily with our existing Selenium test scripts. Sauce Labs was definitely more geared towards our goals at the moment which were to automation functional/regression testing and build it into our release pipeline.
    Incentivized
    Read full review
    Scalability
    IBM
    No answers on this topic
    Sauce Labs
    With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.
    Incentivized
    Read full review
    Return on Investment
    IBM
    • It's part of CLM suite so it can be used to manage the whole lifecycle with tight integration with development module (Rational Team Concert) and quality module (Rational Quality Manager).
    • Comprehensive reports and dashboards provide better visibility.
    • License cost is on higher side.
    Incentivized
    Read full review
    Sauce Labs
    • Eh... Negligible? Being on AWS West makes it quite a few hops for us, so the process times out every now and again. That is frustrating.
    • I can't really speak to the dollars, as I am not privy to the information.
    Incentivized
    Read full review
    ScreenShots

    Sauce Labs Screenshots

    Screenshot of Sauce Labs UI optimized for continuous integration workflows.