TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Sauce Labs

    Score6.8 out of 10
    N/ASauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired…

    $19

    per month

    VMware ESXi

    Score7.4 out of 10
    N/AA bare-metal hypervisor that installs directly onto a physical server. With direct access to and control of underlying resources, VMware ESXi partitions hardware to consolidate applications and cut costs.N/A
    Pricing
    Sauce LabsVMware ESXi
    Editions & Modules
    Live Testing
    $19.00
    per month
    Virtual Cloud
    $149.00
    per month
    No answers on this topic
    Offerings
    Pricing Offerings
    Sauce LabsVMware ESXi
    Free Trial
    YesNo
    Free/Freemium Version
    YesYes
    Premium Consulting/Integration Services
    YesNo
    Entry-level Setup FeeOptionalNo setup fee
    Additional DetailsFree service available for Open Source projects.—
    More Pricing Information
    Community Pulse
    Sauce LabsVMware ESXi
    Considered Both Products
    Sauce Labs
    No answer on this topic
    VMware by Broadcom
    No answer on this topic
    Key User Insights
    Would buy again
    90%
    Would buy again
    19 Answers
    98%
    Would buy again
    93 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    19 Answers
    97%
    Delivers good value for the price
    86 Answers
    Happy with the feature set
    95%
    Happy with the feature set
    20 Answers
    99%
    Happy with the feature set
    94 Answers
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    11 Answers
    99%
    Lived up to sales and marketing promises
    82 Answers
    Implementation went as expected
    90%
    Implementation went as expected
    18 Answers
    100%
    Implementation went as expected
    91 Answers
    Features
    Sauce LabsVMware ESXi
    Server Virtualization
    Comparison of Server Virtualization features of Sauce Labs and VMware ESXi
    Feature
    Sauce Labs
    -
    Ratings
    VMware ESXi
    8.2
    128 Ratings
    2% above category average
    Virtual machine automated provisioning00 Ratings8.0116 Ratings
    Management console00 Ratings9.0128 Ratings
    Live virtual machine backup00 Ratings8.0112 Ratings
    Live virtual machine migration00 Ratings8.0116 Ratings
    Hypervisor-level security00 Ratings8.0117 Ratings
    Best Alternatives
    Sauce LabsVMware ESXi
    Small Businesses
    TestComplete
    Score8 out of 10
    Proxmox VE
    Score9.2 out of 10
    Medium-sized Companies
    OpenText UFT One
    Score8 out of 10
    VMware vSOM (discontinued)
    Score10 out of 10
    Enterprises
    SoapUI Open Source
    Score8.3 out of 10
    IBM PowerVM
    Score9.6 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Sauce LabsVMware ESXi
    Likelihood to Recommend
    5.6
    (158 ratings)
    9.0
    (129 ratings)
    Likelihood to Renew
    9.3
    (20 ratings)
    10.0
    (6 ratings)
    Usability
    8.4
    (20 ratings)
    9.0
    (6 ratings)
    Availability
    10.0
    (4 ratings)
    10.0
    (2 ratings)
    Performance
    8.0
    (4 ratings)
    9.0
    (2 ratings)
    Support Rating
    8.3
    (15 ratings)
    10.0
    (55 ratings)
    Implementation Rating
    7.5
    (6 ratings)
    10.0
    (3 ratings)
    Configurability
    8.2
    (3 ratings)
    10.0
    (2 ratings)
    Contract Terms and Pricing Model
    -
    (0 ratings)
    5.1
    (2 ratings)
    Ease of integration
    9.1
    (2 ratings)
    10.0
    (2 ratings)
    Product Scalability
    10.0
    (4 ratings)
    10.0
    (2 ratings)
    Vendor post-sale
    9.0
    (4 ratings)
    10.0
    (2 ratings)
    Vendor pre-sale
    9.0
    (4 ratings)
    10.0
    (2 ratings)
    User Testimonials
    Sauce LabsVMware ESXi
    Likelihood to Recommend
    Sauce Labs
    Having used some of the competitor's tools over the year I would say that SauceLabs provides a lot of value for money if you plan to run long sets of tests with high frequencies. Paying for a single slot means you can run tests whenever you want without creeping costs but it does make running tests in parallel require an extra slot. Currently, our test suite takes over three hours to run and at the moment it is cost prohibitive to purchase an extra slot. However, having access to live testing and integration with Appium is great.
    Incentivized
    Read full review
    VMware by Broadcom
    If you're looking for the industry standard in server virtualization, I would recommend ESXi. After decades of expertise in the field, VMware continues to provide a strong product, production-ready, with an easy-to-learn interface that allows for quick management along with less costly upfront onboarding and training. Grab the free personal-use license and install in your homelab to start!
    Incentivized
    Read full review
    Pros
    Sauce Labs
    • Provides a comprehensive selection of browser and platform versions for test automation and CI/CD pipeline support
    • Provides a rich selection of browser/platform availability for customer issue reproduction
    • Provides a comprehensive set of virtual mobile device configurations for automation and availability
    • Sauce Labs' SaaS and self service tools work and perform well
    Incentivized
    Read full review
    VMware by Broadcom
    • Resource management. The automatic load balancing works very well to ensure no host is taxed disproportionately compared to the others.
    • Templates and cloning. It is very easy to set up a template and spin up new servers based on a specific setup. This makes server management very streamlined.
    • VM management. The vSphere interface is very easy to use and navigate. Everything is responsive and it works when you need it to. The options are also robust while also being arranged in a straightforward manner.
    Incentivized
    Read full review
    Cons
    Sauce Labs
    • I've had four changes in account managers over the past couple of years. They ranged from super experienced/advocate to some that seems relatively junior/a bit removed. I understand this happens but clarity on what I can expect with these partnerships would be valuable. What I've gotten in the end has varied dramatically.
    Incentivized
    Read full review
    VMware by Broadcom
    • VMware ESXi can improve on the UI that is installed on the bare metal machine. The menus can be hard to navigate when looking for simple configuration items.
    • VMware ESXi can improve on the stability of their overall hypervisor. There have been a few times we had to reinstall due to corruption of VMware ESXi.
    • I would like to see VMware ESXi do better at adding more standard free features in their consumer version of VMware ESXi. For example, having the ability to back up virtual machines is good practice and something that would be very nice if offered in their free version.
    Incentivized
    Read full review
    Likelihood to Renew
    Sauce Labs
    As we currently know, there's nothing on the market with a big feature set like saucelabs at their current price point. Along with the business not having to learn a whole new tool to use again and the ability to refresh our private devices and the continuously growing number of public devices available and features.
    Incentivized
    Read full review
    VMware by Broadcom
    It is critical to our business, what started out as a way to do certain functions, it has now become core to ensuring our product is available to our customers and reducing our costs to operate and reduce our recovery time and provisioning servers. Their support is great and the costs to renew is reasonable.
    Incentivized
    Read full review
    Usability
    Sauce Labs
    It is an incredibly easy service to use for what its primary intention is. The only reason a point is deducted is because more feature enrichment can be done around the Sauce Connect Proxy utility and the Jenkins Sauce OnDemand plugin. User Account administration also needs more work, such as the addition of user groups, rather than a simple hierarchy of users.
    Incentivized
    Read full review
    VMware by Broadcom
    The interface is fairly intuitive for most things, and the areas that are a little less obvious usually have fantastic documentation in the online knowledgebase. In 3-4 years of managing our ESXi hosts, I think that I have only opened 4-5 support cases for things that I could not figure out myself or find answers to on the website.
    Incentivized
    Read full review
    Reliability and Availability
    Sauce Labs
    Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.
    Incentivized
    Read full review
    VMware by Broadcom
    Without the need to patch the servers with bug fixes and enhancements we whave not experienced any downtime with VMware issues. Even the bug fixes and updates do not cause of downtime as we just migrate the servers to the opposite node and update the one and then move servers back. Very simple and painless.
    Incentivized
    Read full review
    Performance
    Sauce Labs
    The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.
    Incentivized
    Read full review
    VMware by Broadcom
    We do not notice any difference between a physical and virtual server running the same workload. In fact we can scale quicker with the virtual server than we can with the physical.
    Incentivized
    Read full review
    Support Rating
    Sauce Labs
    The people here are just so friendly and personable. For instance, Tristan Lombard answered every single email with a very cheery tone and not only did he diagnose my issue, he also made sure to ask how my day was going. Keep it up
    Incentivized
    Read full review
    VMware by Broadcom
    I can't say enough good about VMware's support team. To an individual they take ownership of the case, provide thorough answers, and follow up regularly. On one occasion, a problem we experienced with NSX Endpoint was escalated to development for a permanent resolution after a workaround was found. In my experience, most companies would have tried to find a way to close a case like that instead of taking it all the way. Most importantly, when production is down and every second counts, they VMware teams understand that urgency and treat your issue as if it were the only one they had to deal with. You can't ask for better.
    Incentivized
    Read full review
    Implementation Rating
    Sauce Labs
    I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started
    Read full review
    VMware by Broadcom
    Jsut read and follow anything your storage provider may require to allow the integration of VMware with storage operations, outside of that VMware jsut works.
    Incentivized
    Read full review
    Alternatives Considered
    Sauce Labs
    We have also tested out Browser Stack, which at the time was more geared towards manual testing. Although it appeared to support more mobile devices/browsers, we also wanted something that can plugin in easily with our existing Selenium test scripts. Sauce Labs was definitely more geared towards our goals at the moment which were to automation functional/regression testing and build it into our release pipeline.
    Incentivized
    Read full review
    VMware by Broadcom
    As long as you're using Nutanix AOS on Nutanix hardware and are paying their software support fees, AOS is a valid competitor to VMware and can save money due to not needing a license and having their server management system built into the base host management system. If you aren't using Nutanix hardware, however, VMWare is in most cases the best way to go. I cannot comment on HyperV, but most IT people I know either use it because they have to (most) or they like it better (not many).
    Incentivized
    Read full review
    Contract Terms and Pricing Model
    Sauce Labs
    No answers on this topic
    VMware by Broadcom
    it has been fair and easy to understand. I know VMware is looking at wanting to change from CPU to core pricing so we will see what that looks like when it happens.
    Incentivized
    Read full review
    Scalability
    Sauce Labs
    With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.
    Incentivized
    Read full review
    VMware by Broadcom
    We started out with a two-server cluster and adding a third or fourth is very straightforward and simple with no issues. You just need to be aware of the size of your Vcenter Server to handle the workload, but still the resources needed is very minimal
    Incentivized
    Read full review
    Return on Investment
    Sauce Labs
    • Eh... Negligible? Being on AWS West makes it quite a few hops for us, so the process times out every now and again. That is frustrating.
    • I can't really speak to the dollars, as I am not privy to the information.
    Incentivized
    Read full review
    VMware by Broadcom
    • VMWare ESXi licensing is affordable for our business - and the licensing model is simplistic. Not like that of Microsoft with having to keep track of server licenses and CAL licenses for users.
    • VMWare ESXi also has hardware-monitoring built-in, so that further saves us money from having to be spent with another vendor.
    • As much as I hate the saying "a single pane of glass" does fit for this product. You can manage your servers, monitor hardware status, create and export backup snapshots, manage virtual NICs, connect to various storage devices. We're very happy with this product.
    Incentivized
    Read full review
    ScreenShots

    Sauce Labs Screenshots

    Screenshot of Sauce Labs UI optimized for continuous integration workflows.