Feature-packed & Attractively Priced
March 06, 2019
Feature-packed & Attractively Priced
Score 10 out of 10
Vetted Review
Verified User
Overall Satisfaction with QuestionPro
We use QuestionPro at the campuses of The University of Tennessee across the state. We use it to collect research data and internal administrative information. We launch around 1,200 surveys per month and our team supports survey design and deployment. We then help with the statistical analysis of the survey responses.
- Before choosing QuestionPro, we evaluated it and Qualtrics, SurveyGizmo, and SurveyMonkey. A committee tested each of 141 key features on all four products. QuestionPro did well in the comparison and we have ended up using even more features that we tested. The summary of that work can be found here: https://oit.utk.edu/research/documentation/Qualtrics-to-questionpro/.
- The way it handles anonymous surveys is particularly good. With most products, you have to remember to check the "anonymous" box to prevent it from saving email addresses or other identifiable data. But if you forget to do so, you can't tell by taking the survey. Question pro uses "Respondent Anonymity Assurance" that must be turned on by the company (a quick request from the chat window will suffice) and then it can never be turned off. This activates a link that appears on the bottom left-hand of each survey page. Clicking it takes the survey participant to a company page which assures them that the anonymous feature is indeed turned on.
- It has a very nice combination of great power and ease of use.
- The support we have received from the company has been excellent. Our team has worked with around 30 research software vendors for over 35 years and this company stands out as being extremely responsive to our needs. We told them we needed a migration tool to help us move from Qualtrics to QuestionPro and they created one in just a few weeks. They've added or improved a number of other features for us, at no charge.
- We have tracked each feature that we've used and so far it's 178 of them. We have sent them a list of things to improve one of these was about randomizing the order questions to each participant to prevent order-based bias. They do this, but we have a case where we need to select a block of questions at random, then select the questions only from within the chosen block. They don't do this yet but they're working on adding it.
- Timing how long it takes to answer a question can provide interesting information. QuestionPro does that, but we have one odd situation where we need to prevent a participant from clicking "Next" until they have been forced to look at an image for a specific amount of time. We've requested that feature but given how odd it is, we don't anticipate it being added soon.
- Since we're a major research university, we don't really look at ROI as comanpanies do. However, when we switched from using Qualtrics, our five year contract with QuestionPro saved us over $900,000.
- The only negative impact was that it takes time and effort to move to any new tool.
QuestionPro and Qualtrics are both good products with extensive feature sets. However, Qualtrics starts licenses very inexpensively, then after it becomes clear that changing vendors would be expensive, they commonly double the price. That happened to us and if you search the Educause discussion archives, you'll see that this is their usual approach: EDUCAUSE CIO Community Group Listserv <CIO@LISTSERV.EDUCAUSE.EDU> and the EDUCAUSE IT Procurement and Supplier Management Community Group Listserv <ITPSM@LISTSERV.EDUCAUSE.EDU>.
Compared to what QuestionPro, Qualtrics asked us for eight times as much money. These two products are just too similar to justify much difference at in cost.
Compared to what QuestionPro, Qualtrics asked us for eight times as much money. These two products are just too similar to justify much difference at in cost.