QuestionPro vs. Sawtooth Lighthouse Studio

QuestionPro is great for forced-choice and Likert-scale data, and it easily turns raw data into readable statistics. The simple interface lacks attractiveness but is easy to learn and use, even for members outside the digital age. QuestionPro is less effective for qualitative data and short answer responses in large quantities. Reporting and analytic features leave this information in the bulky design, clogging the report and preventing cohesive presentation of the data.

Incentivized

Anyone wanting to design and analyze advanced studies, particularly those that incorporate discrete choice modeling (such as MaxDiff and / or Conjoint) should be using Sawtooth Lighthouse Studio. The capabilities and flexibility offered by this platform for these choices is far beyond any other platform I am aware of. It is less appropriate where you need the survey tool to 'play well with others.' Two examples: 1) pulling in live data streams so they can be cleaned and visualized. 2) Integrating into any service where an API call is appropriate such as adding / removing people from a mailing list, incentive management tool, or qualitative community tool.

Incentivized

• Before choosing QuestionPro, we evaluated it and Qualtrics, SurveyGizmo, and SurveyMonkey. A committee tested each of 141 key features on all four products. QuestionPro did well in the comparison and we have ended up using even more features that we tested. The summary of that work can be found here: https://oit.utk.edu/research/documentation/qualtrics-to-questionpro/.
• The way it handles anonymous surveys is particularly good. With most products, you have to remember to check the "anonymous" box to prevent it from saving email addresses or other identifiable data. But if you forget to do so, you can't tell by taking the survey. Question pro uses "Respondent Anonymity Assurance" that must be turned on by the company (a quick request from the chat window will suffice) and then it can never be turned off. This activates a link that appears on the bottom left-hand of each survey page. Clicking it takes the survey participant to a company page which assures them that the anonymous feature is indeed turned on.
• It has a very nice combination of great power and ease of use.
• The support we have received from the company has been excellent. Our team has worked with around 30 research software vendors for over 35 years and this company stands out as being extremely responsive to our needs. We told them we needed a migration tool to help us move from Qualtrics to QuestionPro and they created one in just a few weeks. They've added or improved a number of other features for us, at no charge.

• Powerful programming capabilities
• Advanced analysis
• Fantastic customer and technical support
• Good documentation

Incentivized

• The current user interface for designing and editing questions is truly awful. A big step backwards from earlier user interfaces which were great.
• Customer support is not very helpful.
• Results of survey are not exported in a way that is easy to translate into R data frame.

• They could focus on integrating API type functionality
• I would love if the data came out labeled
• I am not a fan of the 'limited' time a study can stay up. This causes issues with longitudinal studies.

Incentivized

It's a fine product, but it's also a very competitive field, so it wouldn't take much to knock QuestionPro from top tier status. I would like to see more functionality in all programs, so whichever program does that first is likely to get my money in the next round of budgeting.

QuestionPro is very easy to use. There are lots of question types and drag and drop functionality. There are lots of ways that make the platform easy to use

It is incredibly powerful, very rhobust and has fantastic support. The only reasons I'm not giving it a higher rating are 1) There is a very steep learning curve when it comes to designing more complex studies. 2) It is difficult to get Sawtooth Lighthouse Studio to 'talk' to other systems as the Perl upon which it is built is not really designed to work with API calls, etc.

Incentivized

They offer email, chat, and phone support. I have used the chat support several times. Response time was fast, but the rep did not always have the answer. Inquiries are answered quickly and thoroughly.

I cannot explain how great the support team is. They are prompt and very thorough in their responses.

Incentivized

Try every feature and test take your surveys multiple times, running through different scenarios.

First of all, QuestionPro has powerful futures when we compare it with others. I am not sure but somehow interface of the product is always important for some more than its functionality. QuestionPro has many features, functionality and has a great interface. It is easy to use and a software that is easy to understand.

Incentivized

While QuestioPro has the capability to build surveys and even do some advanced analysis, it is less powerful (and less intuitive) than Sawtooth Lighthouse Studio. It cannot handle studies with the complexity we are used to designing. The CMNTY Platform was initially sold to us as a combined Quant / Qual platform, but we found very quickly that the quant side of it is extremely limited.

Incentivized

• QuestionPro is being used to automate surveys that were previously done by hand. We would not have been able to do this without the anonymous tracking feature. It has cut turnaround of reports by more than half.
• This is of course more efficient, but this could be expected of any software that automates a survey for you.

• Our business is survey data so we rely heavily on sawtooth
• The advanced design and analytics are incredibly useful
• Negative - I wish it would work natively with API calls

Incentivized