TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Litmus from Validity

    Score8.6 out of 10
    N/ALitmus, from Validity, is an email marketing solution used to create error-free emails in less time. It is also used to build email campaigns, personalize and test them thoroughly, monitor deliverability, and analyze email performance.N/A

    Sauce Labs

    Score6.8 out of 10
    N/ASauce Labs is a cloud-based platform for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous integration workflows. (The vendor says that when tests are automated and run in parallel on multiple virtual machines across many different browser, platform and device combinations, testing time is reduced and developer time is freed up from managing infrastructure.) The Sauce Labs testing cloud is intended to be paired…

    $19

    per month

    Pricing
    Litmus from ValiditySauce Labs
    Editions & Modules
    No answers on this topic
    Live Testing
    $19.00
    per month
    Virtual Cloud
    $149.00
    per month
    Offerings
    Pricing Offerings
    Litmus from ValiditySauce Labs
    Free Trial
    NoYes
    Free/Freemium Version
    NoYes
    Premium Consulting/Integration Services
    NoYes
    Entry-level Setup FeeNo setup feeOptional
    Additional Details—Free service available for Open Source projects.
    More Pricing Information
    Community Pulse
    Litmus from ValiditySauce Labs
    Considered Both Products
    Validity
    No answer on this topic
    Sauce Labs
    No answer on this topic
    Key User Insights
    Would buy again
    99%
    Would buy again
    294 Answers
    90%
    Would buy again
    19 Answers
    Delivers good value for the price
    98%
    Delivers good value for the price
    214 Answers
    100%
    Delivers good value for the price
    19 Answers
    Happy with the feature set
    99%
    Happy with the feature set
    296 Answers
    95%
    Happy with the feature set
    20 Answers
    Lived up to sales and marketing promises
    98%
    Lived up to sales and marketing promises
    174 Answers
    100%
    Lived up to sales and marketing promises
    11 Answers
    Implementation went as expected
    98%
    Implementation went as expected
    175 Answers
    90%
    Implementation went as expected
    18 Answers
    Features
    Litmus from ValiditySauce Labs
    Email & Online Marketing
    Comparison of Email & Online Marketing features of Litmus from Validity and Sauce Labs
    Feature
    Litmus from Validity
    6.8
    377 Ratings
    17% below category average
    Sauce Labs
    -
    Ratings
    WYSIWYG email editor9.159 Ratings00 Ratings
    Dynamic content8.659 Ratings00 Ratings
    Ability to test dynamic content8.1239 Ratings00 Ratings
    Landing pages2.64 Ratings00 Ratings
    A/B testing6.511 Ratings00 Ratings
    Mobile optimization9.4352 Ratings00 Ratings
    Email deliverability reporting8.5273 Ratings00 Ratings
    List management7.08 Ratings00 Ratings
    Triggered drip sequences1.02 Ratings00 Ratings
    Reporting & Analytics
    Comparison of Reporting & Analytics features of Litmus from Validity and Sauce Labs
    Feature
    Litmus from Validity
    7.1
    256 Ratings
    7% below category average
    Sauce Labs
    -
    Ratings
    Dashboards7.229 Ratings00 Ratings
    Standard reports7.5253 Ratings00 Ratings
    Custom reports6.6181 Ratings00 Ratings
    Pre-Send Testing
    Comparison of Pre-Send Testing features of Litmus from Validity and Sauce Labs
    Feature
    Litmus from Validity
    8.5
    357 Ratings
    4% above category average
    Sauce Labs
    -
    Ratings
    URL Validation9.3269 Ratings00 Ratings
    Link Tracking9.2234 Ratings00 Ratings
    Image Validation7.65 Ratings00 Ratings
    Inbox Display8.56 Ratings00 Ratings
    Email Accessibility Tools6.73 Ratings00 Ratings
    Spelling and Grammar Check7.31 Ratings00 Ratings
    Spam Testing9.5268 Ratings00 Ratings
    Email Previews9.6354 Ratings00 Ratings
    Best Alternatives
    Litmus from ValiditySauce Labs
    Small Businesses
    Mad Mimi
    Score10 out of 10
    TestComplete
    Score8 out of 10
    Medium-sized Companies
    Campaign Monitor by Marigold
    Score9 out of 10
    OpenText UFT One
    Score8 out of 10
    Enterprises
    Emma by Marigold
    Score8.5 out of 10
    SoapUI Open Source
    Score8.3 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Litmus from ValiditySauce Labs
    Likelihood to Recommend
    9.1
    (429 ratings)
    5.6
    (158 ratings)
    Likelihood to Renew
    9.0
    (32 ratings)
    9.3
    (20 ratings)
    Usability
    8.0
    (22 ratings)
    8.4
    (20 ratings)
    Availability
    7.6
    (8 ratings)
    10.0
    (4 ratings)
    Performance
    7.3
    (8 ratings)
    8.0
    (4 ratings)
    Support Rating
    9.1
    (2 ratings)
    8.3
    (15 ratings)
    In-Person Training
    4.5
    (2 ratings)
    -
    (0 ratings)
    Online Training
    4.5
    (3 ratings)
    -
    (0 ratings)
    Implementation Rating
    2.2
    (13 ratings)
    7.5
    (6 ratings)
    Configurability
    3.9
    (7 ratings)
    8.2
    (3 ratings)
    Ease of integration
    10.0
    (2 ratings)
    9.1
    (2 ratings)
    Product Scalability
    3.9
    (8 ratings)
    10.0
    (4 ratings)
    Vendor post-sale
    3.6
    (5 ratings)
    9.0
    (4 ratings)
    Vendor pre-sale
    5.5
    (4 ratings)
    9.0
    (4 ratings)
    User Testimonials
    Litmus from ValiditySauce Labs
    Likelihood to Recommend
    Validity
    Proofing your emails is necessary. This is a tool that allows you to see how your email not only renders on multiple devices but how it performs. Some email building platforms will tell you their drag and drop templates are ready to go, however they stop short of analyzing accessibility, checking links, load speed among other things. I've also experienced drag and drop template issues as new email clients are released. Litmus provides peace of mind that you did your due diligence on crafting your email. While Litmus does provide some reporting you will not see every typical analytic an email report offers. However, you can use your Litmus data to enhance your email reports which in turn creates a robust view of email performance.
    Incentivized
    Read full review
    Sauce Labs
    Having used some of the competitor's tools over the year I would say that SauceLabs provides a lot of value for money if you plan to run long sets of tests with high frequencies. Paying for a single slot means you can run tests whenever you want without creeping costs but it does make running tests in parallel require an extra slot. Currently, our test suite takes over three hours to run and at the moment it is cost prohibitive to purchase an extra slot. However, having access to live testing and integration with Appium is great.
    Incentivized
    Read full review
    Pros
    Validity
    • We haven’t explored the personalization features in depth yet, aside from using the Add-to-Calendar option, but we're excited to dig in further. Tools like live polls offer an easy way to boost engagement in our product marketing emails, and we see a lot of potential in using these templates to enhance personalization moving forward.
    • Litmus’ continuing education resources have been really helpful. I recently read an article on email deliverability that offered practical insights my team can apply moving forward. I especially appreciate how Litmus uses real examples and stats from the brands they work with—it makes the content feel actionable and relevant.
    • Online Training.
    Incentivized
    Read full review
    Sauce Labs
    • Provides a comprehensive selection of browser and platform versions for test automation and CI/CD pipeline support
    • Provides a rich selection of browser/platform availability for customer issue reproduction
    • Provides a comprehensive set of virtual mobile device configurations for automation and availability
    • Sauce Labs' SaaS and self service tools work and perform well
    Incentivized
    Read full review
    Cons
    Validity
    • I've not seen many limitations but I have noticed that sometimes emails sent from our CRM take too long to land in Litmus, or sometimes don't land at all.
    • As a beginner it was quite difficult for me to make my way around the platform - I thought "Create new" CTA was actually creating something new, maybe "Import from CRM" would have been more understandable. There were a few others but I remember this one.
    • In the Emails section, whenever I hover over an email, I want to be able to copy the subject line instead of getting the different CTAs appear intrusively (Summary, Builder, Previews & QA, Proof, Analytics, Monitor) - maybe these could appear on the bottom of the textbox, instead of them being imposed on top?
    Incentivized
    Read full review
    Sauce Labs
    • I've had four changes in account managers over the past couple of years. They ranged from super experienced/advocate to some that seems relatively junior/a bit removed. I understand this happens but clarity on what I can expect with these partnerships would be valuable. What I've gotten in the end has varied dramatically.
    Incentivized
    Read full review
    Likelihood to Renew
    Validity
    It's one the best tools that we've found for this type of tool but we would like some additional features like spell check so if there's a platform that features that with everything else Litmus has, then we'd potentially look to move over to that platform instead. However, we are overall pretty help with the platform
    Incentivized
    Read full review
    Sauce Labs
    As we currently know, there's nothing on the market with a big feature set like saucelabs at their current price point. Along with the business not having to learn a whole new tool to use again and the ability to refresh our private devices and the continuously growing number of public devices available and features.
    Incentivized
    Read full review
    Usability
    Validity
    Litmus has integrations that make the software an integrated part of my work every day. Being able to test right within my email builder is just brilliant. Daily I also use the web interface to review analytics and spam testing. Overall it is one of the pieces of software I use daily without any complaints or issues.
    Incentivized
    Read full review
    Sauce Labs
    It is an incredibly easy service to use for what its primary intention is. The only reason a point is deducted is because more feature enrichment can be done around the Sauce Connect Proxy utility and the Jenkins Sauce OnDemand plugin. User Account administration also needs more work, such as the addition of user groups, rather than a simple hierarchy of users.
    Incentivized
    Read full review
    Reliability and Availability
    Validity
    We have never had a problem with Litmus being unavailable so I would say their availability is fantastic. There might have been one time years ago that the site was down briefly but it also might have been a server issue on my end. Either way, Litmus was back up and running in a very short time
    Incentivized
    Read full review
    Sauce Labs
    Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.
    Incentivized
    Read full review
    Performance
    Validity
    As with all technology, there are inevitably use-cases where you are unable to get to your original goal without some good old-fashioned experimenting. Some situations will (and are) more urgent which complicates an effective integration of a new process or a new team using an existing process but the "issues" are regularly resolved by re-starting the process specific to when Litmus is introduced to a project. If it doesn't come out the way you're anticipating, run it again and verify there is an issue before declaring all is lost
    Incentivized
    Read full review
    Sauce Labs
    The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.
    Incentivized
    Read full review
    Support Rating
    Validity
    Absolutely fantastic support. It runs circles around the competition. They regularly reach out and chat, even if it's just to see if there's any issues we need to discuss. They clearly want the business and don't forget you once you sign the contract which is an issue with other similar services.
    Incentivized
    Read full review
    Sauce Labs
    The people here are just so friendly and personable. For instance, Tristan Lombard answered every single email with a very cheery tone and not only did he diagnose my issue, he also made sure to ask how my day was going. Keep it up
    Incentivized
    Read full review
    In-Person Training
    Validity
    It was very informative one on one session for me. I was able to use Litmus without any issues.
    Incentivized
    Read full review
    Sauce Labs
    No answers on this topic
    Online Training
    Validity
    It has all the required information.
    Incentivized
    Read full review
    Sauce Labs
    No answers on this topic
    Implementation Rating
    Validity
    I didn’t really personally participate much in the implementation of Litmus, but from what I observed during the process, it was a smooth process with minimal disruptions. The team was able to get up and running quickly, and the platform’s user-friendly interface made onboarding fairly easy for everyone involved from the start.
    Incentivized
    Read full review
    Sauce Labs
    I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started
    Read full review
    Alternatives Considered
    Validity
    This is not applicable to my role as I have used Litmus to test emails since I have started. Because of the ease of use, timeliness, consistent quality, and affordability that Litmus offers, I haven't found the need to look at similar products or organizations. If all of these features continue to stay strong, I don't plan on changing providers
    Incentivized
    Read full review
    Sauce Labs
    We have also tested out Browser Stack, which at the time was more geared towards manual testing. Although it appeared to support more mobile devices/browsers, we also wanted something that can plugin in easily with our existing Selenium test scripts. Sauce Labs was definitely more geared towards our goals at the moment which were to automation functional/regression testing and build it into our release pipeline.
    Incentivized
    Read full review
    Scalability
    Validity
    With our enterprise account, scalability is not an issue. I have not yet seen or heard of significant issues with user access, API connections for integrations etc. This includes down time for "Scheduled Maintenance" as some providers call them, Litmus has the technology backing to support a global team with a 24-hour workday across regions
    Incentivized
    Read full review
    Sauce Labs
    With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.
    Incentivized
    Read full review
    Return on Investment
    Validity
    • Litmus saves our team so much time by making the QA and email review process so much easier, streamlined, and efficient.
    • We often send out campaigns out to thousands of members, and Litmus gives us the assurance and peace of mind that everything is working as it should before it gets sent out.
    • Decreases the number of email review cycles we go through.
    Incentivized
    Read full review
    Sauce Labs
    • Eh... Negligible? Being on AWS West makes it quite a few hops for us, so the process times out every now and again. That is frustrating.
    • I can't really speak to the dollars, as I am not privy to the information.
    Incentivized
    Read full review
    ScreenShots

    Litmus from Validity Screenshots

    Screenshot of Litmus Personalize Essentials, with live polls to give subscribers a voice and drive email engagement.Screenshot of Litmus Email Guardian, featuring 24/7 link monitoring to safeguard emails.Screenshot of Litmus' integrated insights reports, that can automatically combine metrics from Salesforce Marketing Cloud with subscriber engagement insights from Litmus.Screenshot of campaign preview, available in 100+ popular email clientsScreenshot of Litmus' inbox previewing and feedback tools, that help users to spot and fix issues early.

    Sauce Labs Screenshots

    Screenshot of Sauce Labs UI optimized for continuous integration workflows.