BrowserStack vs. Sauce Labs vs. IBM Turbonomic

If you need immediate testing (for example, from Azure pipelines agents), use BrowserStack instead of LambdaTest (which makes you wait in a "pool" until the device/platform combo you are querying is accessible). If you don't need your tests to be immediate and prefer a wider range of devices, then use Lambdatest.

Having used some of the competitor's tools over the year I would say that SauceLabs provides a lot of value for money if you plan to run long sets of tests with high frequencies. Paying for a single slot means you can run tests whenever you want without creeping costs but it does make running tests in parallel require an extra slot. Currently, our test suite takes over three hours to run and at the moment it is cost prohibitive to purchase an extra slot. However, having access to live testing and integration with Appium is great.

Incentivized

Datacenter Consolidation and Hardware Optimization: This scenario is relevant to you as a hardware manager. It applies when you have physical servers (like Power or System z) and want to maximize virtual machine density. Why it works: IBM Turbonomic analyzes the peak usage times of each VM. If VM "A" is active during the day and VM "B" at night, it places them on the same physical host. Ideal scenario: Data migration projects or when you're told, "[...], there's no budget for more servers this year, make everything fit on what we have." Consolidación de Datacenters y Optimización de Hardware,Este escenario te toca de cerca como encargado de Hardware. Cuando tienes servidores físicos (como los Power o System z) y quieres maximizar la densidad de máquinas virtuales.Por qué funciona: IBM Turbonomic analiza las horas pico de cada VM. Si la VM "A" es activa de día y la VM "B" de noche, las coloca en el mismo host físico.Escenario ideal: Proyectos de migración de datos o cuando te dicen: "[...], no hay presupuesto para más servidores este año, haz que quepa todo en lo que tenemos". This review was originally written in Spanish and has been translated into English using a third-party translation tool. While we strive for accuracy, some nuances or meanings may not be perfectly captured.

Incentivized

• Reliable cross-browser, cross-device testing
• integration with JIRA to add screenshots directly to bugs etc
• Live mobile device testing for an extra layer of confidence
• Customer support has been very consistent and reliable
• User interface is incredibly simple to use and easy to train new users on

Incentivized

• Provides a comprehensive selection of browser and platform versions for test automation and CI/CD pipeline support
• Provides a rich selection of browser/platform availability for customer issue reproduction
• Provides a comprehensive set of virtual mobile device configurations for automation and availability
• Sauce Labs' SaaS and self service tools work and perform well

Incentivized

• Presentation is nice. Its easy to understand what your looking at and the data that is being presented to you.
• Properly identify resource utilization and recommendations for action on how VMs can be improved and resources can be better utilized.
• It was also able to tell us the same information and analysis for cloud resources. I was not expecting that.

Incentivized

• The parallel execution is limited and is still in beta state. Once it starts to work properly, it will be more helpful
• The paid subscription can be a bit of an issue for some individuals or organizations as the charges are a bit too much
• Some of the devices do not open or load properly and are not available to test at times

Incentivized

• I've had four changes in account managers over the past couple of years. They ranged from super experienced/advocate to some that seems relatively junior/a bit removed. I understand this happens but clarity on what I can expect with these partnerships would be valuable. What I've gotten in the end has varied dramatically.

Incentivized

• It would be nice if the UI included a break-down of features that are both licensed as well as un-licensed. That way, you could not only see what you have, but what you don't.
• The right-sizing recommendations are great, but very little info is given about why the recommendation is being made. More info would not only increase understanding, but would also help drive decision-making.

Incentivized

It's almost the 3rd year for us and it's renewal time for us. So yes, we are already discussing how many licenses we need to increase as users are increasing internally. So it's 100% sure that we are already planning renewal this year as well BrowserStack with live and app automate.

Incentivized

As we currently know, there's nothing on the market with a big feature set like saucelabs at their current price point. Along with the business not having to learn a whole new tool to use again and the ability to refresh our private devices and the continuously growing number of public devices available and features.

Incentivized

We are certainly happy with Turbonomic as a whole and have invested quite a bit of time and effort into learning the ins and outs of the product. We have our reporting setup the way we want it and have gained definite value from these features. I will say though that many products nowadays are offering more native monitoring, reporting, and alerting features which may eventually steer us away from this product

Incentivized

So many options that it can be a little overwhelming, but the core functions are easy to find and use and it's usually not too hard to figure things out for the more complex tasks. Very easy to boot up a device and a specific browser from the dashboard to begin a manual website test.

Incentivized

It is an incredibly easy service to use for what its primary intention is. The only reason a point is deducted is because more feature enrichment can be done around the Sauce Connect Proxy utility and the Jenkins Sauce OnDemand plugin. User Account administration also needs more work, such as the addition of user groups, rather than a simple hierarchy of users.

Incentivized

Excellent approach to larger VM organizational management. They have an very clean integrated dashboard that allows us to see everything in our environment and what that is doing in real-time. It works on multiple hyper-visors really well and integrates capacity planning on my local site as well as my cloud locations.

Incentivized

I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all

Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.

Incentivized

VMTurbo has not caused any outages by not doing what we expect it to do.

Incentivized

The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.

Incentivized

The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.

Incentivized

It allocates resources among applications by showing more on the cost breakdown by cloud service, with metrics on cloud provider information like Azure Management, Identity, Networking, Storage with costs per day, and total services costs. This then could facilitate and show the corresponding actions thereafter upon scaling.

Incentivized

I've not had much direct interaction with the BrowserStack support team. The help and community are great and we've not run into any issue that has really required us to reach out. I guess having a stable and easy to use system means you may never need to contact support.

Incentivized

The people here are just so friendly and personable. For instance, Tristan Lombard answered every single email with a very cheery tone and not only did he diagnose my issue, he also made sure to ask how my day was going. Keep it up

Incentivized

When I contact support I get a quick response and they are able to solve my problem quickly. I also get a sense that they want to make sure that we are getting value from the product and walk me through whatever steps are needed to accomplish my goals.

Incentivized

Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.

Incentivized

Alex (from VMTurbo) has worked with the product for years and helped develop the product. He was very knowledgeable and was able to provide our support team with details knowledge on how to get our deployment configured correctly as well as help with another VMTurbo POC within another customers environment.

Incentivized

It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.

Incentivized

After buying VMTurbo Operations Manager, I was invited to an online user training event. I felt this training was effective and dug just deep enough to be informative yet still keep my attention. Additionally, the webinar was free.

Incentivized

I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.

I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started

The implementation was very simple. Just upload an OVA file and power on the VM. Once it comes up enter some networking information and you can then access the web interface. From there, just begin configuring the system for your environment by adding you license and the various virtual environments and storage through the inventory tab

Incentivized

BrowserStack products has been found better for low code automations and visual regression techniques. We have been struggling to maintain the API endpoint sanity tests and writing a lot of code for them while releasing the builds, while we chose BrowserStack accessibility solutions, we found it a way easier than we thought and worked it up.

Incentivized

We have also tested out Browser Stack, which at the time was more geared towards manual testing. Although it appeared to support more mobile devices/browsers, we also wanted something that can plugin in easily with our existing Selenium test scripts. Sauce Labs was definitely more geared towards our goals at the moment which were to automation functional/regression testing and build it into our release pipeline.

Incentivized

As the organization had experience of years in using IBM products, we had the confidence that they will provide us with great support. And we needed a reliable solution as a financial institute to ensure continuous operations. Even though the price was very high, we made the correct decision to go ahead with IBM Turbonomic as the feedback from existing users in the region was very positive. We needed a solution which was capable of handling our automation requirements. All these were green in IBM Turbonomic.

Incentivized

No Vendors were involved, directly dealt with Browserstack

Incentivized

I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose

Incentivized

With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.

Incentivized

It’s very scalable.

Incentivized

Not used

Incentivized

Professional services were always there to guide us in our transformation to the cloud. They understood our business model and then were able to provide guidance on what we needed from the tool.

Incentivized

• It reduced the cost of buying multiple devices as we have multiple devices access in it
• Easily accessible from anywhere due to it cloud availability
• Introducing this to our client also helped us in building trust as well as winning their confidence during deliverables

Incentivized

• Eh... Negligible? Being on AWS West makes it quite a few hops for us, so the process times out every now and again. That is frustrating.
• I can't really speak to the dollars, as I am not privy to the information.

Incentivized

• Application performance has been a big one. With Turbonomic keeping everything running at top performance, it can make changes when extra resources are need, quicker than somebody being notified and then making the necessary changes.
• Turbonomic has been a great cost savings for us on multiple occasions. We use it every time we are improving servers.
• With the planning feature we get the best performance form new hardware purchases

Incentivized