Likelihood to Recommend When you have to test the UI and how it behaves when certain actions are performed, you need something that can automate the browsers. This is where Selenium comes to the rescue. If you have to test APIs and not the frontend (UI), I would recommend going with other libraries that support HTTP Requests. Selenium is good only when you have no choice but to run the steps on a browser.
Read full review If you're looking for the industry standard in server virtualization, I would recommend ESXi. After decades of expertise in the field, VMware continues to provide a strong product, production-ready, with an easy-to-learn interface that allows for quick management along with less costly upfront onboarding and training. Grab the free personal-use license and install in your homelab to start!
Read full review Pros For any web based UI automation, Selenium is the best tool out there to automate your tests. It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from. There is a huge community of users and can get many answers on StackOverFlow. It has lot of other plugins to make your tests even more efficient. Read full review Resource management. The automatic load balancing works very well to ensure no host is taxed disproportionately compared to the others. Templates and cloning. It is very easy to set up a template and spin up new servers based on a specific setup. This makes server management very streamlined. VM management. The vSphere interface is very easy to use and navigate. Everything is responsive and it works when you need it to. The options are also robust while also being arranged in a straightforward manner. Read full review Cons Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive. Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources. Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action. Read full review VMware ESXi can improve on the UI that is installed on the bare metal machine. The menus can be hard to navigate when looking for simple configuration items. VMware ESXi can improve on the stability of their overall hypervisor. There have been a few times we had to reinstall due to corruption of VMware ESXi. I would like to see VMware ESXi do better at adding more standard free features in their consumer version of VMware ESXi. For example, having the ability to back up virtual machines is good practice and something that would be very nice if offered in their free version. Read full review Likelihood to Renew We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
Read full review It is critical to our business, what started out as a way to do certain functions, it has now become core to ensuring our product is available to our customers and reducing our costs to operate and reduce our recovery time and provisioning servers. Their support is great and the costs to renew is reasonable.
Read full review Usability As I mentioned earlier, the reason I use Selenium is because there is a fairly widespread community of users, and user support services are at a good level. because the application is open source, it works on many platforms (Windows, Linux, IOS) without any problems. In addition, it gives us a lot of options for writing functional tests. For errors that we receive through the application, we can easily find the reasons for errors in the forums.
Read full review The interface is fairly intuitive for most things, and the areas that are a little less obvious usually have fantastic documentation in the online knowledgebase. In 3-4 years of managing our ESXi hosts, I think that I have only opened 4-5 support cases for things that I could not figure out myself or find answers to on the website.
Read full review Reliability and Availability Without the need to patch the servers with bug fixes and enhancements we whave not experienced any downtime with VMware issues. Even the bug fixes and updates do not cause of downtime as we just migrate the servers to the opposite node and update the one and then move servers back. Very simple and painless.
Read full review Performance We do not notice any difference between a physical and virtual server running the same workload. In fact we can scale quicker with the virtual server than we can with the physical.
Read full review Support Rating Selenium does not have technical support available easily. You have to go through forums to get the information you need. However, there are excellent forums out there that make it easy to troubleshoot. The open-source flexibility makes it difficult to have dedicated support.
Read full review I can't say enough good about VMware's support team. To an individual they take ownership of the case, provide thorough answers, and follow up regularly. On one occasion, a problem we experienced with NSX Endpoint was escalated to development for a permanent resolution after a workaround was found. In my experience, most companies would have tried to find a way to close a case like that instead of taking it all the way. Most importantly, when production is down and every second counts, they VMware teams understand that urgency and treat your issue as if it were the only one they had to deal with. You can't ask for better.
Read full review Implementation Rating We did everything we needed to use it. Now we can execute our tests on different operational systems and browsers running few tests simultaneously. We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets. We use SauceLabs for our test execution and Jenkins for continuous integration.
Read full review Jsut read and follow anything your storage provider may require to allow the integration of VMware with storage operations, outside of that VMware jsut works.
Read full review Alternatives Considered At the time of adoption, there were not many other alternatives that were even close to being competitive when it comes to browser testing. As far as I know now to this day, there is still little competition to Selenium for what it does. Any other browser-based testing still utilises Selenium to interact with the browser.
Read full review As long as you're using
Nutanix AOS on Nutanix hardware and are paying their software support fees, AOS is a valid competitor to VMware and can save money due to not needing a license and having their server management system built into the base host management system. If you aren't using Nutanix hardware, however, VMWare is in most cases the best way to go. I cannot comment on HyperV, but most IT people I know either use it because they have to (most) or they like it better (not many).
Read full review Contract Terms and Pricing Model it has been fair and easy to understand. I know VMware is looking at wanting to change from CPU to core pricing so we will see what that looks like when it happens.
Read full review Scalability We started out with a two-server cluster and adding a third or fourth is very straightforward and simple with no issues. You just need to be aware of the size of your Vcenter Server to handle the workload, but still the resources needed is very minimal
Read full review Return on Investment There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change. This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests. We are able to screenshot and save entire sites before and after launch with a program the automation engineer created We can compare large volumes of data against data in excel docs with a program created using Selenium Read full review VMWare ESXi licensing is affordable for our business - and the licensing model is simplistic. Not like that of Microsoft with having to keep track of server licenses and CAL licenses for users. VMWare ESXi also has hardware-monitoring built-in, so that further saves us money from having to be spent with another vendor. As much as I hate the saying "a single pane of glass" does fit for this product. You can manage your servers, monitor hardware status, create and export backup snapshots, manage virtual NICs, connect to various storage devices. We're very happy with this product. Read full review ScreenShots