Litmus from Validity vs. Sinch Mailgun

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Litmus from Validity
Score 9.0 out of 10
N/A
Litmus, from Validity, is an email marketing solution used to create error-free emails in less time. It is also used to build email campaigns, personalize and test them thoroughly, monitor deliverability, and analyze email performance.
$500
per month
Sinch Mailgun
Score 9.2 out of 10
N/A
Mailgun is a transactional email API service which was owned and supported by Rackspace (acquired in 2012) and then spun off in 2017 as an independent and standalone entity. It is now supported by Sinch since that company's acquisition of Mailgun and Mailjet, through acquiring Pathwire.
$35
per month
Pricing
Litmus from ValiditySinch Mailgun
Editions & Modules
No answers on this topic
Foundation
$35
per month
Growth
$80
per month
Scale
$90
per month
Flex
Free
Offerings
Pricing Offerings
Litmus from ValiditySinch Mailgun
Free Trial
YesYes
Free/Freemium Version
NoYes
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional DetailsLitmus offers different plan types to fit various needs, offering monthly and annual plans, as well as fully customizable Enterprise plans.
More Pricing Information
Community Pulse
Litmus from ValiditySinch Mailgun
Considered Both Products
Litmus from Validity
Sinch Mailgun

No answer on this topic

Features
Litmus from ValiditySinch Mailgun
Email & Online Marketing
Comparison of Email & Online Marketing features of Product A and Product B
Litmus from Validity
5.4
356 Ratings
39% below category average
Sinch Mailgun
-
Ratings
WYSIWYG email editor8.255 Ratings00 Ratings
Dynamic content8.056 Ratings00 Ratings
Ability to test dynamic content7.6231 Ratings00 Ratings
Landing pages2.63 Ratings00 Ratings
A/B testing1.84 Ratings00 Ratings
Mobile optimization9.4345 Ratings00 Ratings
Email deliverability reporting8.3252 Ratings00 Ratings
List management1.82 Ratings00 Ratings
Triggered drip sequences1.01 Ratings00 Ratings
Reporting & Analytics
Comparison of Reporting & Analytics features of Product A and Product B
Litmus from Validity
6.6
234 Ratings
16% below category average
Sinch Mailgun
-
Ratings
Dashboards5.610 Ratings00 Ratings
Standard reports7.7233 Ratings00 Ratings
Custom reports6.7165 Ratings00 Ratings
Pre-Send Testing
Comparison of Pre-Send Testing features of Product A and Product B
Litmus from Validity
9.2
346 Ratings
13% above category average
Sinch Mailgun
-
Ratings
URL Validation9.0261 Ratings00 Ratings
Link Tracking9.1229 Ratings00 Ratings
Spam Testing9.3258 Ratings00 Ratings
Email Previews9.6344 Ratings00 Ratings
Best Alternatives
Litmus from ValiditySinch Mailgun
Small Businesses
Mad Mimi
Mad Mimi
Score 10.0 out of 10
Mailjet
Mailjet
Score 8.5 out of 10
Medium-sized Companies
VerticalResponse
VerticalResponse
Score 10.0 out of 10
Mailjet
Mailjet
Score 8.5 out of 10
Enterprises
Emma by Marigold
Emma by Marigold
Score 8.7 out of 10

No answers on this topic

All AlternativesView all alternativesView all alternatives
User Ratings
Litmus from ValiditySinch Mailgun
Likelihood to Recommend
9.2
(370 ratings)
9.1
(29 ratings)
Likelihood to Renew
8.9
(27 ratings)
-
(0 ratings)
Usability
8.6
(21 ratings)
10.0
(3 ratings)
Availability
7.7
(8 ratings)
10.0
(1 ratings)
Performance
7.3
(8 ratings)
9.0
(1 ratings)
Support Rating
-
(0 ratings)
7.4
(7 ratings)
In-Person Training
4.5
(2 ratings)
-
(0 ratings)
Online Training
4.5
(3 ratings)
-
(0 ratings)
Implementation Rating
2.6
(12 ratings)
-
(0 ratings)
Configurability
4.0
(7 ratings)
-
(0 ratings)
Ease of integration
10.0
(2 ratings)
-
(0 ratings)
Product Scalability
3.7
(8 ratings)
10.0
(1 ratings)
Vendor post-sale
3.6
(5 ratings)
-
(0 ratings)
Vendor pre-sale
5.5
(4 ratings)
-
(0 ratings)
User Testimonials
Litmus from ValiditySinch Mailgun
Likelihood to Recommend
Validity
Proofing your emails is necessary. This is a tool that allows you to see how your email not only renders on multiple devices but how it performs. Some email building platforms will tell you their drag and drop templates are ready to go, however they stop short of analyzing accessibility, checking links, load speed among other things. I've also experienced drag and drop template issues as new email clients are released. Litmus provides peace of mind that you did your due diligence on crafting your email. While Litmus does provide some reporting you will not see every typical analytic an email report offers. However, you can use your Litmus data to enhance your email reports which in turn creates a robust view of email performance.
Read full review
Sinch (formerly CLX Communications)
Mailgun's pay-as-you-go pricing structure is fantastic, especially if you don't need to send that much email. The pricing, including the free tier, is much more generous than what you can get with some pricier providers, like SendGrid. I mainly just use Mailgun as an SMTP server for web services, and the service has been set-up-and-forget, which is great because I never even have to log onto the Mailgun website and do any work. Mailing list support also looks great for rolling-your-own and not relying on more expensive mailing list services.
Read full review
Pros
Validity
  • We haven’t explored the personalization features in depth yet, aside from using the Add-to-Calendar option, but we're excited to dig in further. Tools like live polls offer an easy way to boost engagement in our product marketing emails, and we see a lot of potential in using these templates to enhance personalization moving forward.
  • Litmus’ continuing education resources have been really helpful. I recently read an article on email deliverability that offered practical insights my team can apply moving forward. I especially appreciate how Litmus uses real examples and stats from the brands they work with—it makes the content feel actionable and relevant.
  • Online Training.
Read full review
Sinch (formerly CLX Communications)
  • Its SMTP is very easy to use and it integrates easy with all CMS and frameworks.
  • It allows you to have a record of the incoming/outgoing emails and get useful statistics about them.
  • Thanks to their 5000 free emails per month, it is a very good option to startups and small companies.
Read full review
Cons
Validity
  • I've not seen many limitations but I have noticed that sometimes emails sent from our CRM take too long to land in Litmus, or sometimes don't land at all.
  • As a beginner it was quite difficult for me to make my way around the platform - I thought "Create new" CTA was actually creating something new, maybe "Import from CRM" would have been more understandable. There were a few others but I remember this one.
  • In the Emails section, whenever I hover over an email, I want to be able to copy the subject line instead of getting the different CTAs appear intrusively (Summary, Builder, Previews & QA, Proof, Analytics, Monitor) - maybe these could appear on the bottom of the textbox, instead of them being imposed on top?
Read full review
Sinch (formerly CLX Communications)
  • No built-in templating features (This was a bit sad after coming from Mandrill which excelled at this)
  • Dashboard UI (although easy to use) is a bit dated in appearance
  • Logs are cumbersome compared to Mandrill
  • Setting up TLD (top level domain) names (things like .online or .church) that are not common require an email to tech support (this is annoying)
  • Sometimes can be slow in delivery
  • Shared IP addresses can be SPAM filtered or delayed (requires an email to support to have a new one assigned - Note: this can be mitigated by buying a dedicated one for a monthly fee)
Read full review
Likelihood to Renew
Validity
It's one the best tools that we've found for this type of tool but we would like some additional features like spell check so if there's a platform that features that with everything else Litmus has, then we'd potentially look to move over to that platform instead. However, we are overall pretty help with the platform
Read full review
Sinch (formerly CLX Communications)
No answers on this topic
Usability
Validity
Litmus has integrations that make the software an integrated part of my work every day. Being able to test right within my email builder is just brilliant. Daily I also use the web interface to review analytics and spam testing. Overall it is one of the pieces of software I use daily without any complaints or issues.
Read full review
Sinch (formerly CLX Communications)
The time for the initial setup is very quick, since you can start sending (thus developing) from their sandbox in no time. The actual configuration involves, as usual, some DNS changes that may require time but are well explained and documented. Once everything is set up, there are a lot of monitoring tools that you can use to optimize your lists.
Read full review
Reliability and Availability
Validity
We have never had a problem with Litmus being unavailable so I would say their availability is fantastic. There might have been one time years ago that the site was down briefly but it also might have been a server issue on my end. Either way, Litmus was back up and running in a very short time
Read full review
Sinch (formerly CLX Communications)
There have been a few minor outages through the years, but nothing more than a few minutes. These small outages are to be expected in any kind of a SaaS product, but Mailgun handles them very well. We designed our software to just retry sending after a while if there is an outage. As far as I know, we have never had to do more than a few retry cycles. This is all automated on our end, so we rarely even notice. Our customers have never noticed any mail sending outages.
Read full review
Performance
Validity
As with all technology, there are inevitably use-cases where you are unable to get to your original goal without some good old-fashioned experimenting. Some situations will (and are) more urgent which complicates an effective integration of a new process or a new team using an existing process but the "issues" are regularly resolved by re-starting the process specific to when Litmus is introduced to a project. If it doesn't come out the way you're anticipating, run it again and verify there is an issue before declaring all is lost
Read full review
Sinch (formerly CLX Communications)
The API and the deliverability of emails is excellent. Their API is very responsive and performs perfectly fine. I have no complaints there. Their management interface though (accessed through the web) is pretty slow though. Searching through lists of emails when I'm tracking down a problem for a customer can take 10+ seconds which is annoyingly high for a modern web app.
Read full review
Support Rating
Validity
I am always so so impressed with the litmus support team. They are not only prompt but attentive and offer very personalised responses and support
Read full review
Sinch (formerly CLX Communications)
You can't seem to get ANY support until you shell out hundreds of dollars per month. I even did this when we could not deliver mail with Mailgun, and the response was slow and inadequate. Nor would they refund my money. I'll never be a customer of Mailgun again.
Read full review
In-Person Training
Validity
I had internal training for how to use, not lead by litmus. Unsure if there was any external training which took place before my time
Read full review
Sinch (formerly CLX Communications)
No answers on this topic
Online Training
Validity
It has all the required information.
Read full review
Sinch (formerly CLX Communications)
No answers on this topic
Implementation Rating
Validity
I didn’t really personally participate much in the implementation of Litmus, but from what I observed during the process, it was a smooth process with minimal disruptions. The team was able to get up and running quickly, and the platform’s user-friendly interface made onboarding fairly easy for everyone involved from the start.
Read full review
Sinch (formerly CLX Communications)
No answers on this topic
Alternatives Considered
Validity
This is not applicable to my role as I have used Litmus to test emails since I have started. Because of the ease of use, timeliness, consistent quality, and affordability that Litmus offers, I haven't found the need to look at similar products or organizations. If all of these features continue to stay strong, I don't plan on changing providers
Read full review
Sinch (formerly CLX Communications)
To be honest, the tools are quite similar and again I dont recommend using them as a standalone products, but they power the work we do via CRMs and our marketing campaigns. Mailgun integrates slightly better which it is why it is the preferred choice for our agency, as it integrations options seem to be better
Read full review
Scalability
Validity
With our enterprise account, scalability is not an issue. I have not yet seen or heard of significant issues with user access, API connections for integrations etc. This includes down time for "Scheduled Maintenance" as some providers call them, Litmus has the technology backing to support a global team with a 24-hour workday across regions
Read full review
Sinch (formerly CLX Communications)
Over the past six years, Mailgun has scaled with our growth very easily. We haven't had to make any code changes to handle our larger volume today, and their pricing has scaled naturally with our growth. As far as I know, there is nothing we will need to do in order to grow 10-fold. Mailgun just handles the load really well.
Read full review
Return on Investment
Validity
  • Litmus saves our team so much time by making the QA and email review process so much easier, streamlined, and efficient.
  • We often send out campaigns out to thousands of members, and Litmus gives us the assurance and peace of mind that everything is working as it should before it gets sent out.
  • Decreases the number of email review cycles we go through.
Read full review
Sinch (formerly CLX Communications)
  • By not investing in our mail server, we have saved huge amount of money and time. For configuration and installation of an email server on Linux-based server, we would have to hire a network administrator.
  • If email delivery is an issue in a hosting provider, another solution is to switch the hosting. Fortunately with Mailgun, we didn't need to try different hosts and experiment which one works best for emails. We can stick to our existing web hosting provider and would not need to change it just for the sake of improving email deliverability.
  • The pricing of Mailgun is very cheap and straightforward. First 10K emails are free every month and that's a big advantage for our organization because our volume of emails is rarely more than 10K per month.
Read full review
ScreenShots

Litmus from Validity Screenshots

Screenshot of Litmus Personalize Essentials, with live polls to give subscribers a voice and drive email engagement.Screenshot of Litmus Email Guardian, featuring 24/7 link monitoring to safeguard emails.Screenshot of Litmus' integrated insights reports, that can automatically combine metrics from Salesforce Marketing Cloud with subscriber engagement insights from Litmus.Screenshot of campaign preview, available in 100+ popular email clientsScreenshot of Litmus' inbox previewing and feedback tools, that help users to spot and fix issues early.