TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Litmus from Validity

    Score8.6 out of 10
    N/ALitmus, from Validity, is an email marketing solution used to create error-free emails in less time. It is also used to build email campaigns, personalize and test them thoroughly, monitor deliverability, and analyze email performance.N/A

    Sinch Mailgun

    Score9.3 out of 10
    N/AMailgun is a transactional email API service which was owned and supported by Rackspace (acquired in 2012) and then spun off in 2017 as an independent and standalone entity. It is now supported by Sinch since that company's acquisition of Mailgun and Mailjet, through acquiring Pathwire.

    $15

    per month

    Pricing
    Litmus from ValiditySinch Mailgun
    Editions & Modules
    No answers on this topic
    Basic
    $15
    10,000 emails/mo included
    Foundation
    $35
    50,000 emails/mo included
    Scale
    $90
    100,000 emails/mo included
    Free
    Free
    100 emails/day included
    Offerings
    Pricing Offerings
    Litmus from ValiditySinch Mailgun
    Free Trial
    NoYes
    Free/Freemium Version
    NoYes
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details
    More Pricing Information
    Community Pulse
    Litmus from ValiditySinch Mailgun
    Considered Both Products
    Validity
    Chose Litmus from Validity
    I explored using Email on Acid in a previous role and at the time Litmus offered many more features that no other competitor including Email on Acid offered.
    Incentivized
    Sinch
    No answer on this topic
    Key User Insights
    Would buy again
    99%
    Would buy again
    292 Answers
    77%
    Would buy again
    10 Answers
    Delivers good value for the price
    98%
    Delivers good value for the price
    212 Answers
    77%
    Delivers good value for the price
    10 Answers
    Happy with the feature set
    99%
    Happy with the feature set
    294 Answers
    85%
    Happy with the feature set
    11 Answers
    Lived up to sales and marketing promises
    98%
    Lived up to sales and marketing promises
    173 Answers
    82%
    Lived up to sales and marketing promises
    9 Answers
    Implementation went as expected
    98%
    Implementation went as expected
    174 Answers
    83%
    Implementation went as expected
    10 Answers
    Features
    Litmus from ValiditySinch Mailgun
    Email & Online Marketing
    Comparison of Email & Online Marketing features of Litmus from Validity and Sinch Mailgun
    Feature
    Litmus from Validity
    6.8
    376 Ratings
    17% below category average
    Sinch Mailgun
    -
    Ratings
    WYSIWYG email editor9.158 Ratings00 Ratings
    Dynamic content8.659 Ratings00 Ratings
    Ability to test dynamic content8.1238 Ratings00 Ratings
    Landing pages2.64 Ratings00 Ratings
    A/B testing6.511 Ratings00 Ratings
    Mobile optimization9.4351 Ratings00 Ratings
    Email deliverability reporting8.5272 Ratings00 Ratings
    List management7.08 Ratings00 Ratings
    Triggered drip sequences1.02 Ratings00 Ratings
    Reporting & Analytics
    Comparison of Reporting & Analytics features of Litmus from Validity and Sinch Mailgun
    Feature
    Litmus from Validity
    7.1
    255 Ratings
    8% below category average
    Sinch Mailgun
    -
    Ratings
    Dashboards7.229 Ratings00 Ratings
    Standard reports7.5252 Ratings00 Ratings
    Custom reports6.6180 Ratings00 Ratings
    Pre-Send Testing
    Comparison of Pre-Send Testing features of Litmus from Validity and Sinch Mailgun
    Feature
    Litmus from Validity
    8.5
    356 Ratings
    4% above category average
    Sinch Mailgun
    -
    Ratings
    URL Validation9.3268 Ratings00 Ratings
    Link Tracking9.2233 Ratings00 Ratings
    Image Validation7.65 Ratings00 Ratings
    Inbox Display8.56 Ratings00 Ratings
    Email Accessibility Tools6.73 Ratings00 Ratings
    Spelling and Grammar Check7.31 Ratings00 Ratings
    Spam Testing9.5267 Ratings00 Ratings
    Email Previews9.6353 Ratings00 Ratings
    Best Alternatives
    Litmus from ValiditySinch Mailgun
    Small Businesses
    Mad Mimi
    Score10 out of 10
    Postmark
    Score7.7 out of 10
    Medium-sized Companies
    Campaign Monitor by Marigold
    Score9 out of 10
    Postmark
    Score7.7 out of 10
    Enterprises
    Emma by Marigold
    Score8.5 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Litmus from ValiditySinch Mailgun
    Likelihood to Recommend
    9.2
    (428 ratings)
    9.5
    (29 ratings)
    Likelihood to Renew
    9.0
    (32 ratings)
    -
    (0 ratings)
    Usability
    8.0
    (22 ratings)
    10.0
    (3 ratings)
    Availability
    7.6
    (8 ratings)
    10.0
    (1 ratings)
    Performance
    7.3
    (8 ratings)
    9.0
    (1 ratings)
    Support Rating
    9.1
    (2 ratings)
    7.4
    (7 ratings)
    In-Person Training
    4.5
    (2 ratings)
    -
    (0 ratings)
    Online Training
    4.5
    (3 ratings)
    -
    (0 ratings)
    Implementation Rating
    2.2
    (13 ratings)
    -
    (0 ratings)
    Configurability
    3.9
    (7 ratings)
    -
    (0 ratings)
    Ease of integration
    10.0
    (2 ratings)
    -
    (0 ratings)
    Product Scalability
    3.9
    (8 ratings)
    10.0
    (1 ratings)
    Vendor post-sale
    3.6
    (5 ratings)
    -
    (0 ratings)
    Vendor pre-sale
    5.5
    (4 ratings)
    -
    (0 ratings)
    User Testimonials
    Litmus from ValiditySinch Mailgun
    Likelihood to Recommend
    Validity
    Proofing your emails is necessary. This is a tool that allows you to see how your email not only renders on multiple devices but how it performs. Some email building platforms will tell you their drag and drop templates are ready to go, however they stop short of analyzing accessibility, checking links, load speed among other things. I've also experienced drag and drop template issues as new email clients are released. Litmus provides peace of mind that you did your due diligence on crafting your email. While Litmus does provide some reporting you will not see every typical analytic an email report offers. However, you can use your Litmus data to enhance your email reports which in turn creates a robust view of email performance.
    Incentivized
    Read full review
    Sinch
    Mailgun's pay-as-you-go pricing structure is fantastic, especially if you don't need to send that much email. The pricing, including the free tier, is much more generous than what you can get with some pricier providers, like SendGrid. I mainly just use Mailgun as an SMTP server for web services, and the service has been set-up-and-forget, which is great because I never even have to log onto the Mailgun website and do any work. Mailing list support also looks great for rolling-your-own and not relying on more expensive mailing list services.
    Incentivized
    Read full review
    Pros
    Validity
    • We haven’t explored the personalization features in depth yet, aside from using the Add-to-Calendar option, but we're excited to dig in further. Tools like live polls offer an easy way to boost engagement in our product marketing emails, and we see a lot of potential in using these templates to enhance personalization moving forward.
    • Litmus’ continuing education resources have been really helpful. I recently read an article on email deliverability that offered practical insights my team can apply moving forward. I especially appreciate how Litmus uses real examples and stats from the brands they work with—it makes the content feel actionable and relevant.
    • Online Training.
    Incentivized
    Read full review
    Sinch
    • Its SMTP is very easy to use and it integrates easy with all CMS and frameworks.
    • It allows you to have a record of the incoming/outgoing emails and get useful statistics about them.
    • Thanks to their 5000 free emails per month, it is a very good option to startups and small companies.
    Incentivized
    Read full review
    Cons
    Validity
    • I've not seen many limitations but I have noticed that sometimes emails sent from our CRM take too long to land in Litmus, or sometimes don't land at all.
    • As a beginner it was quite difficult for me to make my way around the platform - I thought "Create new" CTA was actually creating something new, maybe "Import from CRM" would have been more understandable. There were a few others but I remember this one.
    • In the Emails section, whenever I hover over an email, I want to be able to copy the subject line instead of getting the different CTAs appear intrusively (Summary, Builder, Previews & QA, Proof, Analytics, Monitor) - maybe these could appear on the bottom of the textbox, instead of them being imposed on top?
    Incentivized
    Read full review
    Sinch
    • No built-in templating features (This was a bit sad after coming from Mandrill which excelled at this)
    • Dashboard UI (although easy to use) is a bit dated in appearance
    • Logs are cumbersome compared to Mandrill
    • Setting up TLD (top level domain) names (things like .online or .church) that are not common require an email to tech support (this is annoying)
    • Sometimes can be slow in delivery
    • Shared IP addresses can be SPAM filtered or delayed (requires an email to support to have a new one assigned - Note: this can be mitigated by buying a dedicated one for a monthly fee)
    Incentivized
    Read full review
    Likelihood to Renew
    Validity
    It's one the best tools that we've found for this type of tool but we would like some additional features like spell check so if there's a platform that features that with everything else Litmus has, then we'd potentially look to move over to that platform instead. However, we are overall pretty help with the platform
    Incentivized
    Read full review
    Sinch
    No answers on this topic
    Usability
    Validity
    Litmus has integrations that make the software an integrated part of my work every day. Being able to test right within my email builder is just brilliant. Daily I also use the web interface to review analytics and spam testing. Overall it is one of the pieces of software I use daily without any complaints or issues.
    Incentivized
    Read full review
    Sinch
    The time for the initial setup is very quick, since you can start sending (thus developing) from their sandbox in no time. The actual configuration involves, as usual, some DNS changes that may require time but are well explained and documented. Once everything is set up, there are a lot of monitoring tools that you can use to optimize your lists.
    Incentivized
    Read full review
    Reliability and Availability
    Validity
    We have never had a problem with Litmus being unavailable so I would say their availability is fantastic. There might have been one time years ago that the site was down briefly but it also might have been a server issue on my end. Either way, Litmus was back up and running in a very short time
    Incentivized
    Read full review
    Sinch
    There have been a few minor outages through the years, but nothing more than a few minutes. These small outages are to be expected in any kind of a SaaS product, but Mailgun handles them very well. We designed our software to just retry sending after a while if there is an outage. As far as I know, we have never had to do more than a few retry cycles. This is all automated on our end, so we rarely even notice. Our customers have never noticed any mail sending outages.
    Incentivized
    Read full review
    Performance
    Validity
    As with all technology, there are inevitably use-cases where you are unable to get to your original goal without some good old-fashioned experimenting. Some situations will (and are) more urgent which complicates an effective integration of a new process or a new team using an existing process but the "issues" are regularly resolved by re-starting the process specific to when Litmus is introduced to a project. If it doesn't come out the way you're anticipating, run it again and verify there is an issue before declaring all is lost
    Incentivized
    Read full review
    Sinch
    The API and the deliverability of emails is excellent. Their API is very responsive and performs perfectly fine. I have no complaints there. Their management interface though (accessed through the web) is pretty slow though. Searching through lists of emails when I'm tracking down a problem for a customer can take 10+ seconds which is annoyingly high for a modern web app.
    Incentivized
    Read full review
    Support Rating
    Validity
    Absolutely fantastic support. It runs circles around the competition. They regularly reach out and chat, even if it's just to see if there's any issues we need to discuss. They clearly want the business and don't forget you once you sign the contract which is an issue with other similar services.
    Incentivized
    Read full review
    Sinch
    You can't seem to get ANY support until you shell out hundreds of dollars per month. I even did this when we could not deliver mail with Mailgun, and the response was slow and inadequate. Nor would they refund my money. I'll never be a customer of Mailgun again.
    Incentivized
    Read full review
    In-Person Training
    Validity
    It was very informative one on one session for me. I was able to use Litmus without any issues.
    Incentivized
    Read full review
    Sinch
    No answers on this topic
    Online Training
    Validity
    It has all the required information.
    Incentivized
    Read full review
    Sinch
    No answers on this topic
    Implementation Rating
    Validity
    I didn’t really personally participate much in the implementation of Litmus, but from what I observed during the process, it was a smooth process with minimal disruptions. The team was able to get up and running quickly, and the platform’s user-friendly interface made onboarding fairly easy for everyone involved from the start.
    Incentivized
    Read full review
    Sinch
    No answers on this topic
    Alternatives Considered
    Validity
    This is not applicable to my role as I have used Litmus to test emails since I have started. Because of the ease of use, timeliness, consistent quality, and affordability that Litmus offers, I haven't found the need to look at similar products or organizations. If all of these features continue to stay strong, I don't plan on changing providers
    Incentivized
    Read full review
    Sinch
    To be honest, the tools are quite similar and again I dont recommend using them as a standalone products, but they power the work we do via CRMs and our marketing campaigns. Mailgun integrates slightly better which it is why it is the preferred choice for our agency, as it integrations options seem to be better
    Incentivized
    Read full review
    Scalability
    Validity
    With our enterprise account, scalability is not an issue. I have not yet seen or heard of significant issues with user access, API connections for integrations etc. This includes down time for "Scheduled Maintenance" as some providers call them, Litmus has the technology backing to support a global team with a 24-hour workday across regions
    Incentivized
    Read full review
    Sinch
    Over the past six years, Mailgun has scaled with our growth very easily. We haven't had to make any code changes to handle our larger volume today, and their pricing has scaled naturally with our growth. As far as I know, there is nothing we will need to do in order to grow 10-fold. Mailgun just handles the load really well.
    Incentivized
    Read full review
    Return on Investment
    Validity
    • Litmus saves our team so much time by making the QA and email review process so much easier, streamlined, and efficient.
    • We often send out campaigns out to thousands of members, and Litmus gives us the assurance and peace of mind that everything is working as it should before it gets sent out.
    • Decreases the number of email review cycles we go through.
    Incentivized
    Read full review
    Sinch
    • By not investing in our mail server, we have saved huge amount of money and time. For configuration and installation of an email server on Linux-based server, we would have to hire a network administrator.
    • If email delivery is an issue in a hosting provider, another solution is to switch the hosting. Fortunately with Mailgun, we didn't need to try different hosts and experiment which one works best for emails. We can stick to our existing web hosting provider and would not need to change it just for the sake of improving email deliverability.
    • The pricing of Mailgun is very cheap and straightforward. First 10K emails are free every month and that's a big advantage for our organization because our volume of emails is rarely more than 10K per month.
    Incentivized
    Read full review
    ScreenShots

    Litmus from Validity Screenshots

    Screenshot of Litmus Personalize Essentials, with live polls to give subscribers a voice and drive email engagement.Screenshot of Litmus Email Guardian, featuring 24/7 link monitoring to safeguard emails.Screenshot of Litmus' integrated insights reports, that can automatically combine metrics from Salesforce Marketing Cloud with subscriber engagement insights from Litmus.Screenshot of campaign preview, available in 100+ popular email clientsScreenshot of Litmus' inbox previewing and feedback tools, that help users to spot and fix issues early.