TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Litmus from Validity

    Score8.6 out of 10
    N/ALitmus, from Validity, is an email marketing solution used to create error-free emails in less time. It is also used to build email campaigns, personalize and test them thoroughly, monitor deliverability, and analyze email performance.N/A

    Selenium

    Score8.1 out of 10
    N/ASelenium is open source software for browser automation, primarily used for functional, load, or performance testing of applications.N/A
    Pricing
    Litmus from ValiditySelenium
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    Litmus from ValiditySelenium
    Free Trial
    NoNo
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    Litmus from ValiditySelenium
    Considered Both Products
    Validity
    No answer on this topic
    Open Source
    No answer on this topic
    Key User Insights
    Would buy again
    99%
    Would buy again
    292 Answers
    100%
    Would buy again
    18 Answers
    Delivers good value for the price
    98%
    Delivers good value for the price
    212 Answers
    100%
    Delivers good value for the price
    18 Answers
    Happy with the feature set
    99%
    Happy with the feature set
    294 Answers
    94%
    Happy with the feature set
    17 Answers
    Lived up to sales and marketing promises
    98%
    Lived up to sales and marketing promises
    173 Answers
    100%
    Lived up to sales and marketing promises
    13 Answers
    Implementation went as expected
    98%
    Implementation went as expected
    174 Answers
    100%
    Implementation went as expected
    16 Answers
    Features
    Litmus from ValiditySelenium
    Email & Online Marketing
    Comparison of Email & Online Marketing features of Litmus from Validity and Selenium
    Feature
    Litmus from Validity
    6.8
    376 Ratings
    16% below category average
    Selenium
    -
    Ratings
    WYSIWYG email editor9.158 Ratings00 Ratings
    Dynamic content8.659 Ratings00 Ratings
    Ability to test dynamic content8.1238 Ratings00 Ratings
    Landing pages2.64 Ratings00 Ratings
    A/B testing6.511 Ratings00 Ratings
    Mobile optimization9.4351 Ratings00 Ratings
    Email deliverability reporting8.5272 Ratings00 Ratings
    List management7.08 Ratings00 Ratings
    Triggered drip sequences1.02 Ratings00 Ratings
    Reporting & Analytics
    Comparison of Reporting & Analytics features of Litmus from Validity and Selenium
    Feature
    Litmus from Validity
    7.1
    255 Ratings
    7% below category average
    Selenium
    -
    Ratings
    Dashboards7.229 Ratings00 Ratings
    Standard reports7.5252 Ratings00 Ratings
    Custom reports6.6180 Ratings00 Ratings
    Pre-Send Testing
    Comparison of Pre-Send Testing features of Litmus from Validity and Selenium
    Feature
    Litmus from Validity
    8.5
    356 Ratings
    4% above category average
    Selenium
    -
    Ratings
    URL Validation9.3268 Ratings00 Ratings
    Link Tracking9.2233 Ratings00 Ratings
    Image Validation7.65 Ratings00 Ratings
    Inbox Display8.56 Ratings00 Ratings
    Email Accessibility Tools6.73 Ratings00 Ratings
    Spelling and Grammar Check7.31 Ratings00 Ratings
    Spam Testing9.5267 Ratings00 Ratings
    Email Previews9.6353 Ratings00 Ratings
    Automation Testing
    Comparison of Automation Testing features of Litmus from Validity and Selenium
    Feature
    Litmus from Validity
    -
    Ratings
    Selenium
    10.0
    1 Ratings
    17% above category average
    Record and Automate00 Ratings10.01 Ratings
    Multi-Browser Testing00 Ratings10.01 Ratings
    Test Management00 Ratings10.01 Ratings
    Integrated Version Control00 Ratings10.01 Ratings
    Object Recognition00 Ratings10.01 Ratings
    Data-Driven Testing00 Ratings10.01 Ratings
    Testing Reports & Analytics00 Ratings10.01 Ratings
    Best Alternatives
    Litmus from ValiditySelenium
    Small Businesses
    Mad Mimi
    Score10 out of 10
    BrowserStack
    Score8.5 out of 10
    Medium-sized Companies
    Campaign Monitor by Marigold
    Score9 out of 10
    BlazeMeter
    Score8 out of 10
    Enterprises
    Emma by Marigold
    Score8.5 out of 10
    Tricentis Tosca
    Score8.8 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Litmus from ValiditySelenium
    Likelihood to Recommend
    9.2
    (428 ratings)
    9.2
    (55 ratings)
    Likelihood to Renew
    9.0
    (32 ratings)
    9.2
    (6 ratings)
    Usability
    8.0
    (22 ratings)
    8.8
    (6 ratings)
    Availability
    7.6
    (8 ratings)
    -
    (0 ratings)
    Performance
    7.3
    (8 ratings)
    -
    (0 ratings)
    Support Rating
    9.1
    (2 ratings)
    8.3
    (11 ratings)
    In-Person Training
    4.5
    (2 ratings)
    -
    (0 ratings)
    Online Training
    4.5
    (3 ratings)
    -
    (0 ratings)
    Implementation Rating
    2.2
    (13 ratings)
    9.0
    (3 ratings)
    Configurability
    3.9
    (7 ratings)
    -
    (0 ratings)
    Ease of integration
    10.0
    (2 ratings)
    -
    (0 ratings)
    Product Scalability
    3.9
    (8 ratings)
    -
    (0 ratings)
    Vendor post-sale
    3.6
    (5 ratings)
    -
    (0 ratings)
    Vendor pre-sale
    5.5
    (4 ratings)
    -
    (0 ratings)
    User Testimonials
    Litmus from ValiditySelenium
    Likelihood to Recommend
    Validity
    Proofing your emails is necessary. This is a tool that allows you to see how your email not only renders on multiple devices but how it performs. Some email building platforms will tell you their drag and drop templates are ready to go, however they stop short of analyzing accessibility, checking links, load speed among other things. I've also experienced drag and drop template issues as new email clients are released. Litmus provides peace of mind that you did your due diligence on crafting your email. While Litmus does provide some reporting you will not see every typical analytic an email report offers. However, you can use your Litmus data to enhance your email reports which in turn creates a robust view of email performance.
    Incentivized
    Read full review
    Open Source
    When you have to test the UI and how it behaves when certain actions are performed, you need something that can automate the browsers. This is where Selenium comes to the rescue. If you have to test APIs and not the frontend (UI), I would recommend going with other libraries that support HTTP Requests. Selenium is good only when you have no choice but to run the steps on a browser.
    Incentivized
    Read full review
    Pros
    Validity
    • We haven’t explored the personalization features in depth yet, aside from using the Add-to-Calendar option, but we're excited to dig in further. Tools like live polls offer an easy way to boost engagement in our product marketing emails, and we see a lot of potential in using these templates to enhance personalization moving forward.
    • Litmus’ continuing education resources have been really helpful. I recently read an article on email deliverability that offered practical insights my team can apply moving forward. I especially appreciate how Litmus uses real examples and stats from the brands they work with—it makes the content feel actionable and relevant.
    • Online Training.
    Incentivized
    Read full review
    Open Source
    • For any web based UI automation, Selenium is the best tool out there to automate your tests.
    • It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from.
    • There is a huge community of users and can get many answers on StackOverFlow.
    • It has lot of other plugins to make your tests even more efficient.
    Incentivized
    Read full review
    Cons
    Validity
    • I've not seen many limitations but I have noticed that sometimes emails sent from our CRM take too long to land in Litmus, or sometimes don't land at all.
    • As a beginner it was quite difficult for me to make my way around the platform - I thought "Create new" CTA was actually creating something new, maybe "Import from CRM" would have been more understandable. There were a few others but I remember this one.
    • In the Emails section, whenever I hover over an email, I want to be able to copy the subject line instead of getting the different CTAs appear intrusively (Summary, Builder, Previews & QA, Proof, Analytics, Monitor) - maybe these could appear on the bottom of the textbox, instead of them being imposed on top?
    Incentivized
    Read full review
    Open Source
    • Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
    • Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
    • Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.
    Incentivized
    Read full review
    Likelihood to Renew
    Validity
    It's one the best tools that we've found for this type of tool but we would like some additional features like spell check so if there's a platform that features that with everything else Litmus has, then we'd potentially look to move over to that platform instead. However, we are overall pretty help with the platform
    Incentivized
    Read full review
    Open Source
    We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
    Incentivized
    Read full review
    Usability
    Validity
    Litmus has integrations that make the software an integrated part of my work every day. Being able to test right within my email builder is just brilliant. Daily I also use the web interface to review analytics and spam testing. Overall it is one of the pieces of software I use daily without any complaints or issues.
    Incentivized
    Read full review
    Open Source
    For those who are unfamiliar with coding, there is a bit of a learning curve. There is plenty of helpful documentation and resources but it can take a little time to get the software up and running. Once you get the hang of how Selenium works, and what it can do, you realize how many things you can use it for, and how many processes you can automate.
    Incentivized
    Read full review
    Reliability and Availability
    Validity
    We have never had a problem with Litmus being unavailable so I would say their availability is fantastic. There might have been one time years ago that the site was down briefly but it also might have been a server issue on my end. Either way, Litmus was back up and running in a very short time
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Performance
    Validity
    As with all technology, there are inevitably use-cases where you are unable to get to your original goal without some good old-fashioned experimenting. Some situations will (and are) more urgent which complicates an effective integration of a new process or a new team using an existing process but the "issues" are regularly resolved by re-starting the process specific to when Litmus is introduced to a project. If it doesn't come out the way you're anticipating, run it again and verify there is an issue before declaring all is lost
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Support Rating
    Validity
    Absolutely fantastic support. It runs circles around the competition. They regularly reach out and chat, even if it's just to see if there's any issues we need to discuss. They clearly want the business and don't forget you once you sign the contract which is an issue with other similar services.
    Incentivized
    Read full review
    Open Source
    The Selenium app has a pretty fat community of users. For the problems we are experiencing, we are primarily receiving support from these communities. In addition, there is widespread service support. Instant support is given to the problems we experience when we need Online support. We and our team are happy to provide this support, especially before important deployment processes
    Read full review
    In-Person Training
    Validity
    It was very informative one on one session for me. I was able to use Litmus without any issues.
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Online Training
    Validity
    It has all the required information.
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Implementation Rating
    Validity
    I didn’t really personally participate much in the implementation of Litmus, but from what I observed during the process, it was a smooth process with minimal disruptions. The team was able to get up and running quickly, and the platform’s user-friendly interface made onboarding fairly easy for everyone involved from the start.
    Incentivized
    Read full review
    Open Source
    We did everything we needed to use it. Now we can execute our tests on different operational systems and browsers running few tests simultaneously. We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets. We use SauceLabs for our test execution and Jenkins for continuous integration.
    Incentivized
    Read full review
    Alternatives Considered
    Validity
    This is not applicable to my role as I have used Litmus to test emails since I have started. Because of the ease of use, timeliness, consistent quality, and affordability that Litmus offers, I haven't found the need to look at similar products or organizations. If all of these features continue to stay strong, I don't plan on changing providers
    Incentivized
    Read full review
    Open Source
    At the time of adoption, there were not many other alternatives that were even close to being competitive when it comes to browser testing. As far as I know now to this day, there is still little competition to Selenium for what it does. Any other browser-based testing still utilises Selenium to interact with the browser.
    Incentivized
    Read full review
    Scalability
    Validity
    With our enterprise account, scalability is not an issue. I have not yet seen or heard of significant issues with user access, API connections for integrations etc. This includes down time for "Scheduled Maintenance" as some providers call them, Litmus has the technology backing to support a global team with a 24-hour workday across regions
    Incentivized
    Read full review
    Open Source
    No answers on this topic
    Return on Investment
    Validity
    • Litmus saves our team so much time by making the QA and email review process so much easier, streamlined, and efficient.
    • We often send out campaigns out to thousands of members, and Litmus gives us the assurance and peace of mind that everything is working as it should before it gets sent out.
    • Decreases the number of email review cycles we go through.
    Incentivized
    Read full review
    Open Source
    • There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change.
    • This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests.
    • We are able to screenshot and save entire sites before and after launch with a program the automation engineer created
    • We can compare large volumes of data against data in excel docs with a program created using Selenium
    Incentivized
    Read full review
    ScreenShots

    Litmus from Validity Screenshots

    Screenshot of Litmus Personalize Essentials, with live polls to give subscribers a voice and drive email engagement.Screenshot of Litmus Email Guardian, featuring 24/7 link monitoring to safeguard emails.Screenshot of Litmus' integrated insights reports, that can automatically combine metrics from Salesforce Marketing Cloud with subscriber engagement insights from Litmus.Screenshot of campaign preview, available in 100+ popular email clientsScreenshot of Litmus' inbox previewing and feedback tools, that help users to spot and fix issues early.