Appium vs. Crownpeak Digital Accessibility and Quality vs. TestComplete

1. It's open source which supports range of languages, operating systems and languages. Well suited for Android and IOS mobile automation. Supports all kinds of apps, which makes it flexible and robust mobile testing tool 2. It is less appropriate where we need intercept network call to verify the API calls. Extensive coding experience is required to work Appium

Incentivized

If you have a fully customized cms and have people working on the site with html and css knowledge this is the best tool ever, all specifics can be checked. Using ab tests and optimization services we identify best practices of the website and everywhere the best practices aren't implemented we find using the custom checkpoints. Aspects that cannot be automated via a quick IT solution is turned into a checkpoint and that's great!

Incentivized

Best suited to smaller unit test or tests broken up, couple of forms at a time Not suited - larger regressions test involving multiple systems. - my main regression involving payments has been unsuccessful for the last 3 years despite all working fine separately and while being watched

• It uses WebDriver API so it makes it easy to use for former web test automation engineers.
• It can be managed via the command line via an extensive set of parameters.
• It handles implicit waits at the server side that is especially valuable in distributed infrastructure.

Incentivized

• Preconfigured checkpoints to gather a baseline.
• Reporting at regular intervals to identify pain points.
• Mapping to WCAGG standard to understand how to resolve errors.
• Ability to add customized checkpoints to align with messaging changes
• Aggregating images in a visual repository to scan for relevancy.

Incentivized

• Identifying UI objects and application structure
• Expandability of tests through scripts and script extensions/plugins
• low barrier of entry (you can get started quickly, and other's don't need much explanation to contribute on a basic level)
• Possibility of Jira integration for reporting
• Relatively few (and usually easy to solve) git conflicts when working simultaneously
• easy handling of test data, also for iterative tests

Incentivized

• Element browser sometimes is unreliable and has sporadic fails.
• Appium running is a bit slow, compared to tests written with Appium and with Espresso or XCTest.

Incentivized

• It would be helpful if the Issues page under Website showed the WCAG level for each issue (A, AA, AAA). You currently have to look up the guideline to find the level.
• There is no indicator that a page is currently being scanned. During a website scan, some of the reports are blank or missing information. Having a notification on the main page showing which websites are being scanned would be helpful.
• Some ADA compliance items are left off, such as keyboard navigation, tabbing, etc.
• It doesn't view the websites on mobile devices or if using a screen reader. Some pages or formatting changes depending on resolution. The DQM, from what I have seen, doesn't account for that.

Incentivized

• TestComplete could stand to have a simplified view for different types of users. For instance, as a manager/architecture guy, I'm not so interested in getting into the code and am more interested in file-based interactions.
• TestComplete could use more integration with reporting for things like TeamCity to improve test status visibility.

Incentivized

I am rating 10/10 because Appium can use with multiple programming languages with multiple Test engines. Also, it works for both Android and iOS.

Incentivized

We've seen competitors, they're not doing as well of a job as dqm is. It's a wonderful tool and there a huge opportunities for crownpeak

Incentivized

We have bigger test automation pack using test complete at the same time we also think this is not good performing tool for large number of test automation scripts.

Incentivized

I would like to give 9/10 rating to Appium because of it can easily integrate with popular frameworks and CI/CD tools, as well as it is reliable, flexible and easy to use. The setup can bit complex in initial step, but once on configured it's very easy to use and enables stable and scalable mobile automation for real and cloud devices.

Incentivized

I had a small learning curve in order to become fluent with the platform as it doesn't work like the other automated accessibility tools that I've used. However, once I was up to speed, I like it better than any of the other tools and find the data more useful, digestible, and relevant.

Incentivized

It is usable when you become accustomed to its quirks. Not using it for two months and then you need to re-learn the quirks for some features (but some quirks are so awful that they will never fade from your memory). So, when using it regularly, it is possible to be quite productive, if no big correction in name mapping is needed.

Incentivized

Haven't had issues accessing the dashboard when needed.

No issues with speed and performance

DQM support teams are responsive and knowledgeable, and will spend time working directly with client and agency teams to ensure the best outcomes are achieved. I can't fault the level of input and engagement from Crownpeak support teams across the board.

Some bugs were quickly resolved, but most UX quirks of the tool are just marked "as designed". No follow up for enhancement request.

Incentivized

Product is straight-forward but the training was helpful and beneficial

The initial process is not clear but after the first cookie banner all others are faster to implement.

Incentivized

If you develop a mobile application and your testing process goes in cloud, probably you will face a problem - how to implement a stable connection between your mobile devices and testing servers

Incentivized

If you're an Apple developer, you use Xcode. It's practically a forced necessity. For system testing though, it doesn't have to be. You can have your development team focus on unit and integration tests in their platform and another team automate acceptance tests with a language they are more familiar with.

Incentivized

One of the most similar solutions to Crownpeak is the Yext tool because it has a good set of functions that can be managed from content to customer experiences, it is fascinating to be able to track all user interactions through users, in the same way as in Crownpeak that allows all users to create digital experiences.

TestComplete stacks up against them in terms of GUI and seamless performance. It records each and every step and action been performed in the application and produces a detailed report in a well-structured manner. It can connect and access seamlessly among various databases directly to speed up the testing process.

Incentivized

haven't had issues accessing when needed.

• Appium is open source, so it's free. That's budget friendly right there.
• The ability to write mobile automation tests has saved considerable time for our manual test team, but that is true with most automation tests.
• We use Sauce Labs with our other automation, but Appium works great with Sauce Labs, as well, if I needed to run on emulators and simulators.

Incentivized

• When driving Customer Care, it was great to be able to add the Autofix tool to the web estate - a quick-win that really drives the accessibility agenda.
• Building reports off the back of DQM gives senior stakeholders an understanding of the importance of usability and accessibility.
• The gamification of league tables highlights to stakeholders the areas that need focus and budget in order to improve.

Incentivized

• Saves hundreds of man-hours with either QA testing or data entry
• With the small cost of the product, it has saved the company money with both employee costs as well as the cost of mistakes made by human error or software bugs

Incentivized