Maze vs. QuestionPro vs. UserReplay (discontinued)

Maze User Testing is great if you're interested in doing user research from the comfort of your own desk. You can easily setup usability tests, surveys, card sorting and tree tests among other things to get a better understanding of how customers use your product. The only limitation at the moment with Maze that I can identify is only being able to do unmoderated tests, so if you'd like to be able to ask follow up questions in the moment, Maze is not the tool for you.

Incentivized

QuestionPro is great for forced-choice and Likert-scale data, and it easily turns raw data into readable statistics. The simple interface lacks attractiveness but is easy to learn and use, even for members outside the digital age. QuestionPro is less effective for qualitative data and short answer responses in large quantities. Reporting and analytic features leave this information in the bulky design, clogging the report and preventing cohesive presentation of the data.

Incentivized

Great for online businesses who are well established and want to refine their UX/site performance.

Incentivized

• Reporting is top-tier with filtration, heatmaps, user data, and public URLs for stakeholders
• Figma integration with user testing software is about as fast as it gets
• The experience for testers is practically seamless going from our site to a Maze. Loads of completed Mazes.

• Before choosing QuestionPro, we evaluated it and Qualtrics, SurveyGizmo, and SurveyMonkey. A committee tested each of 141 key features on all four products. QuestionPro did well in the comparison and we have ended up using even more features that we tested. The summary of that work can be found here: https://oit.utk.edu/research/documentation/qualtrics-to-questionpro/.
• The way it handles anonymous surveys is particularly good. With most products, you have to remember to check the "anonymous" box to prevent it from saving email addresses or other identifiable data. But if you forget to do so, you can't tell by taking the survey. Question pro uses "Respondent Anonymity Assurance" that must be turned on by the company (a quick request from the chat window will suffice) and then it can never be turned off. This activates a link that appears on the bottom left-hand of each survey page. Clicking it takes the survey participant to a company page which assures them that the anonymous feature is indeed turned on.
• It has a very nice combination of great power and ease of use.
• The support we have received from the company has been excellent. Our team has worked with around 30 research software vendors for over 35 years and this company stands out as being extremely responsive to our needs. We told them we needed a migration tool to help us move from Qualtrics to QuestionPro and they created one in just a few weeks. They've added or improved a number of other features for us, at no charge.

• Identifying an issue and quickly understanding what the financial impact is
• Seeing how users use and interact with your site, by device
• Reporting on custom events
• Quickly finding a session and replaying it, to watch it back.

Incentivized

• Sometimes Maze breaks the responsiveness of our product
• Also the analytics is not very useful for us. We do manual walkthrough of products
• Few testers that we hire does not read the instructions very well and will abandon the flow

Incentivized

• The current user interface for designing and editing questions is truly awful. A big step backwards from earlier user interfaces which were great.
• Customer support is not very helpful.
• Results of survey are not exported in a way that is easy to translate into R data frame.

• Having confidence in the reports/numbers it pulls
• No function to email out weekly/monthly reports.
• Insights are sometimes difficult to extract

Incentivized

It's a fine product, but it's also a very competitive field, so it wouldn't take much to knock QuestionPro from top tier status. I would like to see more functionality in all programs, so whichever program does that first is likely to get my money in the next round of budgeting.

Maze is easy to use most of the times. It is easy to integrate with Figma, It is easy to find testers worldwide with required filters. Maze gives recorded videos which are helpful in debugging and understanding the problem with flows. A/B testing is easy to add and test. Overall Maze is very easy to use

Incentivized

QuestionPro is very easy to use. There are lots of question types and drag and drop functionality. There are lots of ways that make the platform easy to use

Any issues that presented themselves were dealt with in a quick and efficient manner and fully rectified by the knowledgeable team over at Maze.

Incentivized

They offer email, chat, and phone support. I have used the chat support several times. Response time was fast, but the rep did not always have the answer. Inquiries are answered quickly and thoroughly.

Try every feature and test take your surveys multiple times, running through different scenarios.

A Lookback is an alternative option if you think Maze User Testing is quite expensive for you, but look back has a different approach to Maze User Testing. Lookback focuses on qualitative usability testing instead of quantitative UserTesting. And also, Maze User Testing has a free option but Lookback doesn't have it, but Lookback has a cheaper option at $19/month than Maze.

Incentivized

First of all, QuestionPro has powerful futures when we compare it with others. I am not sure but somehow interface of the product is always important for some more than its functionality. QuestionPro has many features, functionality and has a great interface. It is easy to use and a software that is easy to understand.

Incentivized

Very well, a similar but different system

Incentivized

• Easy to run quant test
• Easy to test with large number of people on production
• Easy to run unmoderated competitor studies

Incentivized

• QuestionPro is being used to automate surveys that were previously done by hand. We would not have been able to do this without the anonymous tracking feature. It has cut turnaround of reports by more than half.
• This is of course more efficient, but this could be expected of any software that automates a survey for you.

• Confirmed our low basket abandonment

Incentivized