Appium vs. BrowserStack vs. Crownpeak Digital Accessibility and Quality

1. It's open source which supports range of languages, operating systems and languages. Well suited for Android and IOS mobile automation. Supports all kinds of apps, which makes it flexible and robust mobile testing tool 2. It is less appropriate where we need intercept network call to verify the API calls. Extensive coding experience is required to work Appium

Incentivized

If you need immediate testing (for example, from Azure pipelines agents), use BrowserStack instead of LambdaTest (which makes you wait in a "pool" until the device/platform combo you are querying is accessible). If you don't need your tests to be immediate and prefer a wider range of devices, then use Lambdatest.

If you have a fully customized cms and have people working on the site with html and css knowledge this is the best tool ever, all specifics can be checked. Using ab tests and optimization services we identify best practices of the website and everywhere the best practices aren't implemented we find using the custom checkpoints. Aspects that cannot be automated via a quick IT solution is turned into a checkpoint and that's great!

Incentivized

• It uses WebDriver API so it makes it easy to use for former web test automation engineers.
• It can be managed via the command line via an extensive set of parameters.
• It handles implicit waits at the server side that is especially valuable in distributed infrastructure.

Incentivized

• Reliable cross-browser, cross-device testing
• integration with JIRA to add screenshots directly to bugs etc
• Live mobile device testing for an extra layer of confidence
• Customer support has been very consistent and reliable
• User interface is incredibly simple to use and easy to train new users on

Incentivized

• Preconfigured checkpoints to gather a baseline.
• Reporting at regular intervals to identify pain points.
• Mapping to WCAGG standard to understand how to resolve errors.
• Ability to add customized checkpoints to align with messaging changes
• Aggregating images in a visual repository to scan for relevancy.

Incentivized

• Element browser sometimes is unreliable and has sporadic fails.
• Appium running is a bit slow, compared to tests written with Appium and with Espresso or XCTest.

Incentivized

• The parallel execution is limited and is still in beta state. Once it starts to work properly, it will be more helpful
• The paid subscription can be a bit of an issue for some individuals or organizations as the charges are a bit too much
• Some of the devices do not open or load properly and are not available to test at times

Incentivized

• It would be helpful if the Issues page under Website showed the WCAG level for each issue (A, AA, AAA). You currently have to look up the guideline to find the level.
• There is no indicator that a page is currently being scanned. During a website scan, some of the reports are blank or missing information. Having a notification on the main page showing which websites are being scanned would be helpful.
• Some ADA compliance items are left off, such as keyboard navigation, tabbing, etc.
• It doesn't view the websites on mobile devices or if using a screen reader. Some pages or formatting changes depending on resolution. The DQM, from what I have seen, doesn't account for that.

Incentivized

I am rating 10/10 because Appium can use with multiple programming languages with multiple Test engines. Also, it works for both Android and iOS.

Incentivized

It's almost the 3rd year for us and it's renewal time for us. So yes, we are already discussing how many licenses we need to increase as users are increasing internally. So it's 100% sure that we are already planning renewal this year as well BrowserStack with live and app automate.

Incentivized

We've seen competitors, they're not doing as well of a job as dqm is. It's a wonderful tool and there a huge opportunities for crownpeak

Incentivized

I would like to give 9/10 rating to Appium because of it can easily integrate with popular frameworks and CI/CD tools, as well as it is reliable, flexible and easy to use. The setup can bit complex in initial step, but once on configured it's very easy to use and enables stable and scalable mobile automation for real and cloud devices.

Incentivized

So many options that it can be a little overwhelming, but the core functions are easy to find and use and it's usually not too hard to figure things out for the more complex tasks. Very easy to boot up a device and a specific browser from the dashboard to begin a manual website test.

Incentivized

I had a small learning curve in order to become fluent with the platform as it doesn't work like the other automated accessibility tools that I've used. However, once I was up to speed, I like it better than any of the other tools and find the data more useful, digestible, and relevant.

Incentivized

I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all

Haven't had issues accessing the dashboard when needed.

The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.

Incentivized

No issues with speed and performance

I've not had much direct interaction with the BrowserStack support team. The help and community are great and we've not run into any issue that has really required us to reach out. I guess having a stable and easy to use system means you may never need to contact support.

Incentivized

DQM support teams are responsive and knowledgeable, and will spend time working directly with client and agency teams to ensure the best outcomes are achieved. I can't fault the level of input and engagement from Crownpeak support teams across the board.

Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.

Incentivized

It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.

Incentivized

Product is straight-forward but the training was helpful and beneficial

I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.

The initial process is not clear but after the first cookie banner all others are faster to implement.

Incentivized

If you're an Apple developer, you use Xcode. It's practically a forced necessity. For system testing though, it doesn't have to be. You can have your development team focus on unit and integration tests in their platform and another team automate acceptance tests with a language they are more familiar with.

Incentivized

BrowserStack products has been found better for low code automations and visual regression techniques. We have been struggling to maintain the API endpoint sanity tests and writing a lot of code for them while releasing the builds, while we chose BrowserStack accessibility solutions, we found it a way easier than we thought and worked it up.

Incentivized

One of the most similar solutions to Crownpeak is the Yext tool because it has a good set of functions that can be managed from content to customer experiences, it is fascinating to be able to track all user interactions through users, in the same way as in Crownpeak that allows all users to create digital experiences.

No Vendors were involved, directly dealt with Browserstack

Incentivized

I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose

Incentivized

haven't had issues accessing when needed.

Not used

Incentivized

• Appium is open source, so it's free. That's budget friendly right there.
• The ability to write mobile automation tests has saved considerable time for our manual test team, but that is true with most automation tests.
• We use Sauce Labs with our other automation, but Appium works great with Sauce Labs, as well, if I needed to run on emulators and simulators.

Incentivized

• It reduced the cost of buying multiple devices as we have multiple devices access in it
• Easily accessible from anywhere due to it cloud availability
• Introducing this to our client also helped us in building trust as well as winning their confidence during deliverables

Incentivized

• When driving Customer Care, it was great to be able to add the Autofix tool to the web estate - a quick-win that really drives the accessibility agenda.
• Building reports off the back of DQM gives senior stakeholders an understanding of the importance of usability and accessibility.
• The gamification of league tables highlights to stakeholders the areas that need focus and budget in order to improve.

Incentivized