April 08, 2023

So close to perfect you can almost taste it.

Nathan Wiggin

Chief Solutions Manager

ComEngage (Market Research, 1-10 employees)

Score 9 out of 10

Vetted Review

Verified User

Incentivized

Use Cases and Deployment Scope

We use Sawtooth Lighthouse Studio as our main data collection tool for surveys. We program and host the surveys using Sawtooth Lighthouse Studio We design them for mixed-mode data collection methods (phone and web). We also use the software to design and analyze discrete choice analysis such as MaxDiff and Conjoint.

Pros and Cons

Powerful programming capabilities
Advanced analysis
Fantastic customer and technical support
Good documentation

They could focus on integrating API type functionality
I would love if the data came out labeled
I am not a fan of the 'limited' time a study can stay up. This causes issues with longitudinal studies.

Likelihood to Recommend

Anyone wanting to design and analyze advanced studies, particularly those that incorporate discrete choice modeling (such as MaxDiff and / or Conjoint) should be using Sawtooth Lighthouse Studio. The capabilities and flexibility offered by this platform for these choices is far beyond any other platform I am aware of. It is less appropriate where you need the survey tool to 'play well with others.' Two examples: 1) pulling in live data streams so they can be cleaned and visualized. 2) Integrating into any service where an API call is appropriate such as adding / removing people from a mailing list, incentive management tool, or qualitative community tool.

Lighthouse Studio Feature Ratings

Survey Format & Appearance (2)

65%

6.5

Themes: 60%
6.0
Custom logo/branding: 70%
7.0

Survey Content (3)

90%

9.0

Changes to live survey: 80%
8.0
Question design help: 90%
9.0
Multiple question types: 100%
10.0

Survey Logic (1)

100%

10.0

Survey logic flexibility: 100%
10.0

Survey Reporting & Analytics (4)

60%

6.0

Response tracking: 60%
6.0
Data export: 40%
4.0
Standard reports: 50%
5.0
Analytics: 90%
9.0

Survey Integrations

N/A

Survey Automation

N/A

Survey Distribution (1)

100%

10.0

Respondent restrictions: 100%
10.0

Survey Administration & Security (2)

100%

10.0

Access controls: 100%
10.0
Compliance: 100%
10.0

Return on Investment

Our business is survey data so we rely heavily on sawtooth
The advanced design and analytics are incredibly useful
Negative - I wish it would work natively with API calls

Alternatives Considered

QuestionPro and CMNTY Platform

While QuestioPro has the capability to build surveys and even do some advanced analysis, it is less powerful (and less intuitive) than Sawtooth Lighthouse Studio. It cannot handle studies with the complexity we are used to designing. The CMNTY Platform was initially sold to us as a combined Quant / Qual platform, but we found very quickly that the quant side of it is extremely limited.

Other Software Used

Displayr, ActiveCampaign

Usability

It is incredibly powerful, very rhobust and has fantastic support. The only reasons I'm not giving it a higher rating are 1) There is a very steep learning curve when it comes to designing more complex studies. 2) It is difficult to get Sawtooth Lighthouse Studio to 'talk' to other systems as the Perl upon which it is built is not really designed to work with API calls, etc.

Support Rating

I cannot explain how great the support team is. They are prompt and very thorough in their responses.

Operating Systems	Unspecified
Mobile Application	No

Lighthouse Studio

Delighted by Qualtrics

Qualtrics

Delighted by Qualtrics

Qualtrics

FormAssembly

Voxco Survey Software

Kantar Marketplace

Survicate

Alchemer

TrueContext

Intouch Insight