Sawtooth Lighthouse Studio vs. UserVoice

Anyone wanting to design and analyze advanced studies, particularly those that incorporate discrete choice modeling (such as MaxDiff and / or Conjoint) should be using Sawtooth Lighthouse Studio. The capabilities and flexibility offered by this platform for these choices is far beyond any other platform I am aware of. It is less appropriate where you need the survey tool to 'play well with others.' Two examples: 1) pulling in live data streams so they can be cleaned and visualized. 2) Integrating into any service where an API call is appropriate such as adding / removing people from a mailing list, incentive management tool, or qualitative community tool.

Incentivized

UserVoice can be an affordable and powerful tool to start engaging customers and employees. It can help manage the entire feedback loop process. But your product management and development teams still need to do their jobs. Remember to have a response SLA in place and ownership for prioritizing and responding to the feedback.

• Powerful programming capabilities
• Advanced analysis
• Fantastic customer and technical support
• Good documentation

Incentivized

• User interface is very simple. Learning the product and teaching the team how to use the product took hardly any time at all.
• Gives visibility into what others are logging. We are able to append 'votes' to certain ideas, rather than having to create an existing idea from scratch.
• Reporting. Tags allow to easily filter through ideas for roadmap planning.

Incentivized

• They could focus on integrating API type functionality
• I would love if the data came out labeled
• I am not a fan of the 'limited' time a study can stay up. This causes issues with longitudinal studies.

Incentivized

• Doesn't always catch obvious spam/we have to do a fair amount of blacklisting
• Doesn't have multiple language options
• No online/email tech support available. You have to call if you have an issue.

Incentivized

I just really liked UserVoice.

It is incredibly powerful, very rhobust and has fantastic support. The only reasons I'm not giving it a higher rating are 1) There is a very steep learning curve when it comes to designing more complex studies. 2) It is difficult to get Sawtooth Lighthouse Studio to 'talk' to other systems as the Perl upon which it is built is not really designed to work with API calls, etc.

Incentivized

The day-to-day usability is good. More technical settings require a bit more effort.

I cannot explain how great the support team is. They are prompt and very thorough in their responses.

Incentivized

Always very responsible and helpful when an issue happened. They eat their own cooking when it comes to using their products.

Have clear goals and owners established before you start using any tool like this. Very important to get accounts and rights setup so that there's no lag time in customer response once things go live. Make sure IT is involved if you plan to use the Single-Sign On (SSO) or any of the access control tools.

While QuestioPro has the capability to build surveys and even do some advanced analysis, it is less powerful (and less intuitive) than Sawtooth Lighthouse Studio. It cannot handle studies with the complexity we are used to designing. The CMNTY Platform was initially sold to us as a combined Quant / Qual platform, but we found very quickly that the quant side of it is extremely limited.

Incentivized

I like the ease of integration into web and mobile apps for UserVoice. It's also a comprehensive bug reporting, user feedback, and knowledge base tool.

Incentivized

• Our business is survey data so we rely heavily on sawtooth
• The advanced design and analytics are incredibly useful
• Negative - I wish it would work natively with API calls

Incentivized

• Transparency: Now we can handle better communication of requests with customers and internal stakeholders.
• We can track better how many ideas are accepted and released vs rejected ones.

Incentivized