QuestionPro vs. Sawtooth Lighthouse Studio

I would recommend it for VERY simple projects. For anything that requires extensive programming, it's probably better to have a professional survey programmer develop the code rather than the research manager or director. Otherwise, it's an easy to use and intuitive program. It's also a good option if pricing is a concern.

Anyone wanting to design and analyze advanced studies, particularly those that incorporate discrete choice modeling (such as MaxDiff and / or Conjoint) should be using Sawtooth Lighthouse Studio. The capabilities and flexibility offered by this platform for these choices is far beyond any other platform I am aware of. It is less appropriate where you need the survey tool to 'play well with others.' Two examples: 1) pulling in live data streams so they can be cleaned and visualized. 2) Integrating into any service where an API call is appropriate such as adding / removing people from a mailing list, incentive management tool, or qualitative community tool.

Incentivized

• Once you have designed a survey it is easy to send out to respondents and administer.
• QuestionPro offers a wide range of question types and sophisticated options such as randomization of responses and logic trees.
• QuestionPro generates basic charts that are decent for visual inspection of results of survey.
• Earlier versions of the user interface were intuitive and easy to use.

• Powerful programming capabilities
• Advanced analysis
• Fantastic customer and technical support
• Good documentation

Incentivized

• I would like the unique key generated for the respondents to be random and not follow a sequential number. We have bypassed this, but it needs additional effort and time.
• There is an option for the "finish page" which is a report that summarises the survey that has just been completed for the respondent has been in "beta" for a long time!
• Some of the advanced report options are only available online and would be useful to be able to download in different formats as are the more standard/simple filtered reports.

• They could focus on integrating API type functionality
• I would love if the data came out labeled
• I am not a fan of the 'limited' time a study can stay up. This causes issues with longitudinal studies.

Incentivized

It's a fine product, but it's also a very competitive field, so it wouldn't take much to knock QuestionPro from top tier status. I would like to see more functionality in all programs, so whichever program does that first is likely to get my money in the next round of budgeting.

QuestionPro is very easy to use. There are lots of question types and drag and drop functionality. There are lots of ways that make the platform easy to use

It is incredibly powerful, very rhobust and has fantastic support. The only reasons I'm not giving it a higher rating are 1) There is a very steep learning curve when it comes to designing more complex studies. 2) It is difficult to get Sawtooth Lighthouse Studio to 'talk' to other systems as the Perl upon which it is built is not really designed to work with API calls, etc.

Incentivized

They offer email, chat, and phone support. I have used the chat support several times. Response time was fast, but the rep did not always have the answer. Inquiries are answered quickly and thoroughly.

I cannot explain how great the support team is. They are prompt and very thorough in their responses.

Incentivized

Try every feature and test take your surveys multiple times, running through different scenarios.

QuestionPro greatly exceeds Google and Microsoft in analytics and data presentation. The ability to filter responses and automatically update statistical evaluation is unrivaled, as the other software primarily export data as CSV or Excel files. Google and QuestionPro are both easier to navigate than OneDrive’s Forms features. QuestionPro’s visual appeal falls short of Google, but it remains comparable with OneDrive.

Incentivized

While QuestioPro has the capability to build surveys and even do some advanced analysis, it is less powerful (and less intuitive) than Sawtooth Lighthouse Studio. It cannot handle studies with the complexity we are used to designing. The CMNTY Platform was initially sold to us as a combined Quant / Qual platform, but we found very quickly that the quant side of it is extremely limited.

Incentivized

• Since we're a major research university, we don't really look at ROI as comanpanies do. However, when we switched from using Qualtrics, our five year contract with QuestionPro saved us over $900,000.
• The only negative impact was that it takes time and effort to move to any new tool.

• Our business is survey data so we rely heavily on sawtooth
• The advanced design and analytics are incredibly useful
• Negative - I wish it would work natively with API calls

Incentivized