Qualtrics XM for Strategy and Research vs. Sawtooth Lighthouse Studio

Qualtrics is a good medium for creating surveys and getting analytics back for it. I think it's easy to learn if you are in the business of creating surveys or if it's part of your studies. It can be a little overwhelming for a brand new user who has never created a survey for the first time. So onboarding could be better.

Anyone wanting to design and analyze advanced studies, particularly those that incorporate discrete choice modeling (such as MaxDiff and / or Conjoint) should be using Sawtooth Lighthouse Studio. The capabilities and flexibility offered by this platform for these choices is far beyond any other platform I am aware of. It is less appropriate where you need the survey tool to 'play well with others.' Two examples: 1) pulling in live data streams so they can be cleaned and visualized. 2) Integrating into any service where an API call is appropriate such as adding / removing people from a mailing list, incentive management tool, or qualitative community tool.

Incentivized

• Qualtrics CoreXM is easy to use for quick one-time surveys or for measuring opinions over time
• It's great for sending/managing RSVPs for meetings or other gatherings or to collect important data like Conflict of Interest declarations.
• Qualtrics CoreXM's reporting and crosstab functionality is beefy and gets better all of the time. I'm always amazed at how easy it is to generate reports for sharing my survey response data and research.

Incentivized

• Powerful programming capabilities
• Advanced analysis
• Fantastic customer and technical support
• Good documentation

Incentivized

• The collaborate feature can be clunky and sometimes we have to remove access and add a person back in for them to see the survey in their lists
• We have a contract through our university and more than one person has created their account in the wrong place, causing some administrative headaches as that is fixed so that we can collaborate on surveys with them.
• I wish it was easier to organize my surveys into folders, there should be a more efficient way to do that.

Incentivized

• They could focus on integrating API type functionality
• I would love if the data came out labeled
• I am not a fan of the 'limited' time a study can stay up. This causes issues with longitudinal studies.

Incentivized

I was impressed a couple years ago when two heads of market research at Fortune 500 companies told me about them, and I've been even more impressed with the advancements I've seen in the last year. I like where the company is headed, and I look forward to using them again in a future role.

All the menus are very user friendly and intuitive. I can always find exactly what I'm looking for and can change anything I need to with ease. All the elements of the survey are adjustable with very little effort and without confusion.

It is incredibly powerful, very rhobust and has fantastic support. The only reasons I'm not giving it a higher rating are 1) There is a very steep learning curve when it comes to designing more complex studies. 2) It is difficult to get Sawtooth Lighthouse Studio to 'talk' to other systems as the Perl upon which it is built is not really designed to work with API calls, etc.

Incentivized

Whenever we have had an issue with trying to figure out how to do something (even though the documentation is incredibly well put together) we have asked Qualtrics support and have always received our answer nearly immediately (I think in maybe 10 times, only once did a support person need to call us back). Qualtrics support is dedicated to solving customer issues right, and in the first contact, if at all possible

I cannot explain how great the support team is. They are prompt and very thorough in their responses.

Incentivized

I still use it. It does everything you need an online survey to do. From heat mapping to complex skip logic and display logic. I use it weekly and it never disappoints

I like being able to easily integrate new colleagues by simply giving them a log in user name and password

]Qualtrics] CoreXM is great if you want something that is a little more [long] lasting and impactful than a simple survey engine, but aren't quite ready for something that is a long term sustainable program. I would put [Qualtrics] CoreXM squarely in the large, defined project phase. CX is more of the program phase, and other lessor vendors are great for the pre-project definition phase

Incentivized

While QuestioPro has the capability to build surveys and even do some advanced analysis, it is less powerful (and less intuitive) than Sawtooth Lighthouse Studio. It cannot handle studies with the complexity we are used to designing. The CMNTY Platform was initially sold to us as a combined Quant / Qual platform, but we found very quickly that the quant side of it is extremely limited.

Incentivized

• Increased productivity due to the highly intuitive user-interface and template saving capabilities.
• Reporting and analytics are extremely valuable. Our team can track responses and share feedback/results extremely quickly.
• If a user has created a great template, they can share to external teams quite easily. It helps other departments!

Incentivized

• Our business is survey data so we rely heavily on sawtooth
• The advanced design and analytics are incredibly useful
• Negative - I wish it would work natively with API calls

Incentivized