We have been blown away by the performance of the QA Wolf team
July 06, 2024

We have been blown away by the performance of the QA Wolf team

Tim Nott | TrustRadius Reviewer
Score 10 out of 10
Vetted Review
Verified User

Overall Satisfaction with QA Wolf

We use QA Wolf for automated end to end (E2) testing.

Regressions errors are a huge problem in software delivery and E2E testing addresses a lot of concerns in this area.

We had several problems implementing E2E testing. It is not a core competency of our existing engineering staff so writing tests was often a slow process. Once we had a test built, running the tests could take a long time, causing an engineer to either have to wait a long period to see if the tests pass, or context switching when they receive an alert that tests failed. To make the tests run faster would require significant investment in infrastructure and an ongoing hosting cost.

QA Wolf addresses all of the above concerns in a cost- and time-efficient manner.

Pros

  • Eliminates the need to have and manage in-house QA Engineers
  • Handles all the infrastructure for testing
  • Runs tests in parallel so Engineers get fast feedback on whether they have introduced a regression error.
  • Reduce costs associated with E2E testing
  • Amazing customer service
  • Excellent integration with our existing workflows

Cons

  • Costs are coming down everywhere in the automation space as AI takes on more jobs. I'd like to see QA Wolf costs scale down as they automate more processes.
  • Our Engineers deliver with more confidence and that has had a positive impact on feature throughput.
  • QA wolf has a large team of QA Engineers and they can easily handle a surge of new coverage requests, where an in house resource would be flooded and cause a bottleneck.
  • We continue to focus our in-house engineering efforts on product improvements rather than diluting our delivery-first culture with a QA mindset.
Every time we open a pull request, we get a reminder to request coverage for the app. Clicking the link pops up a page where we can give the relevant details and add a video from internal user acceptance testing.

When a test does fail, we get an immediate alert in Slack and a ticket is opened in Linear so it can be triaged. Completing the ticket gives feedback to the QA Wolf team that the test can be un-paused.
We chose QA Wolf for the quality of the tests that they write, their flexibility, outstanding customer support, workflow integrations, excellent infrastructure, and competitive pricing. We were not happy with the quality of the tests we were getting with ProdPerfect. We were going to evaluate MuukTest once our proof of concept with QA Wolf was completed, but we were already convinced we had what we wanted, and going with a less capable infrastructure wasn't worth the cost savings.

Do you think QA Wolf delivers good value for the price?

Yes

Are you happy with QA Wolf's feature set?

Yes

Did QA Wolf live up to sales and marketing promises?

Yes

Did implementation of QA Wolf go as expected?

Yes

Would you buy QA Wolf again?

Yes

QA Wolf is an appropriate tool for web-based applications supported by teams that are trying to optimize for speed. Regardless of the size of team, a cost-efficient outsourced option allows the in-house team to focus on feature delivery. If speed is not an issue and costs are the most important concern, trying to do the work using existing resources may be more appropriate. I hope I never work anywhere like that.

Comments

More Reviews of QA Wolf

  1. Home
  2. Testing Services
  3. QA Wolf Reviews
  4. User Review of QA Wolf