Digital.ai Agility vs. Sauce Labs

Scenarios where it works well: 1) Retros can be very well facilitated & notes/action items
can be captured against the sprint. 2) Product Owner can effectively track the story
progress with all the test-cases, design etc. 3) Being good scaling support, it provides good visibility
across multiple teams, programs and agile portfolios, providing a centralized
environment where all our stakeholders can easily work together regardless of location. 4) It provides easy tracking all of your epics,
stories, themes, defects, tasks, tests and issues 5) I like its intuitive UI as for moving stories
around, burning hours. 6) It allows top leadership to visualize
and report their strategic plans, giving all stakeholders the relevant data
that they need to stay dedicated to the project priorities. 7) It can be easily integrated with slack
so for few teams we used slack for collaboration Scenarios where it did not work well: 1) Test Management need improvement in
terms of tracking tests, team had hard time tracking regression test cases. 2) Version one comes with lot of features like
Rally but here we don’t get customizations which is there in Jira where from workflow
to issue everything can be customized based on your team/program/portfolio
requirements. 3) Lot of navigation to access basic
stuff. Example I want to go to bug attachment , there are lt of clicks &
navigation need to do which should be pretty straightforward I feel.

Incentivized

Having used some of the competitor's tools over the year I would say that SauceLabs provides a lot of value for money if you plan to run long sets of tests with high frequencies. Paying for a single slot means you can run tests whenever you want without creeping costs but it does make running tests in parallel require an extra slot. Currently, our test suite takes over three hours to run and at the moment it is cost prohibitive to purchase an extra slot. However, having access to live testing and integration with Appium is great.

Incentivized

• Automated saving of changes, no records can be lost because all items are saved in real-time.
• The watch function, optional but beneficial when managing multiple teams or projects.

Incentivized

• Provides a comprehensive selection of browser and platform versions for test automation and CI/CD pipeline support
• Provides a rich selection of browser/platform availability for customer issue reproduction
• Provides a comprehensive set of virtual mobile device configurations for automation and availability
• Sauce Labs' SaaS and self service tools work and perform well

Incentivized

• Saving of changes is inconsistent. Sometimes the changes appear to save automatically and other times the user needs to click the "Apply" button. Until the user is familiar with when this needs to happen, work can easily be lost.
• This may be a setup configuration issue, but it would be good to be able to set the default team when creating stories. Too often stories are created and the user forgets to enter the team and they need to search the entire database for the story that was just created.

Incentivized

• I've had four changes in account managers over the past couple of years. They ranged from super experienced/advocate to some that seems relatively junior/a bit removed. I understand this happens but clarity on what I can expect with these partnerships would be valuable. What I've gotten in the end has varied dramatically.

Incentivized

As we currently know, there's nothing on the market with a big feature set like saucelabs at their current price point. Along with the business not having to learn a whole new tool to use again and the ability to refresh our private devices and the continuously growing number of public devices available and features.

Incentivized

It is an incredibly easy service to use for what its primary intention is. The only reason a point is deducted is because more feature enrichment can be done around the Sauce Connect Proxy utility and the Jenkins Sauce OnDemand plugin. User Account administration also needs more work, such as the addition of user groups, rather than a simple hierarchy of users.

Incentivized

Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.

Incentivized

The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.

Incentivized

VersionOne provides outstanding training. They have Product Owner training that I recommend every Product Owner attend. They have scrum master training and other agile training that was well worth the money paid because it made the teams more productive. And the support for the tool is incredible. These people live and breathe Agile and are evangelists and enthusiasts.

Incentivized

The people here are just so friendly and personable. For instance, Tristan Lombard answered every single email with a very cheery tone and not only did he diagnose my issue, he also made sure to ask how my day was going. Keep it up

Incentivized

I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started

Basecamp functions much differently from Version One and serves a different purpose, so it's kind of like comparing apples and oranges. However, both V1 and Basecamp have their pros and cons. V1 makes it easier to manage Agile processes, but Basecamp is more user-friendly and can be used for broader purposes. At our organization, we utilize both products. V1 is what we use to manage processes internally, and Basecamp is what we use to manage client-facing processes. If our organization wasn't Agile, I would prefer to use Basecamp for all project management (internal and client-facing), and have done so at previous organizations for which I've worked

Incentivized

We have also tested out Browser Stack, which at the time was more geared towards manual testing. Although it appeared to support more mobile devices/browsers, we also wanted something that can plugin in easily with our existing Selenium test scripts. Sauce Labs was definitely more geared towards our goals at the moment which were to automation functional/regression testing and build it into our release pipeline.

Incentivized

With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.

Incentivized

• I came in near the end of our use of VersionOne (we are migrating to Jira), and I don't operate or think at the business return (ROI) level. I'm not the one to comment on this!
• I suspect that V1 added much clarity to the prioritization of work, and added visibility across entire teams. So I assume that it had a positive impact on returns.

Incentivized

• Eh... Negligible? Being on AWS West makes it quite a few hops for us, so the process times out every now and again. That is frustrating.
• I can't really speak to the dollars, as I am not privy to the information.

Incentivized