Convert Experiences is an experimentation platform that offers features and support to run A/B tests across multiple growth channels. Its enterprise-ready advanced features include full stack experimentation, multi-page testing, post-segmentation, sequential testing, targeting with 40+ filters, triggering tests based on data in other apps (data sources), dynamic triggers, complex goal tracking, and a secure API. It includes 90+ out-of-the box integrations in a…
$399
per month up to 100k tested users per month
Matomo Analytics
Score9 out of 10
N/A
Piwik is an open source analytics platform that enables users to measure web and mobile apps as well as intranet portals. It protects the privacy of users through advanced privacy features and its approach to data ownership. Piwik offers On-premises and Cloud deployment options.
Available in over 50 languages, it is fully customisable and vendor-independent. Piwik offers over 70 integrations with Content Management Systems, Ecommerce solutions, Forums as well as other mobile and web platforms.…
$0
Pricing
Convert Experiences
Matomo Analytics
Editions & Modules
Growth
$399
per month 100k tested users per month
Pro
$5040
per year 1.5M tested users/year
Enterprise
Pricing available on request
From 1M tested users/mo (billed annually)
Free download (open source)
$0
Free 30 day trial
$0
limited to 30 days
Essential
$9
number of pageviews (monthly traffic)
Business
$29
number of pageviews (monthly traffic)
Enterprise
$199
your requirements and monthly traffic
Content Optimization Bundle
$579
per installation
Growth Bundle
$1,149
per installation
Premium Bundle
$1,499
per installation
Email Support Subscription
$2,090
per installation
Offerings
Pricing Offerings
Convert Experiences
Matomo Analytics
Free Trial
Yes
Yes
Free/Freemium Version
No
Yes
Premium Consulting/Integration Services
No
Yes
Entry-level Setup Fee
No setup fee
Optional
Additional Details
1. Annual contract or monthly payments available
2. Pricing is not feature dependent. Some features like integrations, goals, Live Logs are necessary to test successfully. This is why Convert caps by unique tested users - basically visitors who have been bucketed to see a variation and are unique to that variation. As a result the app tested users are always </= the site's net traffic.
On-premise Edition is free to download and install on one's own servers.
Definitely well suited for budget conscious companies that want a solid array of functionality but without having to pay an exorbitant amount. Great for marketing and analytics team members that need the ability to get in and set up tests w/o dev assistance. But, functionality is there for developers to get in and set up more complicated tests.
If you want to balance data-driven marketing and a privacy-minded approach to analytics, Matomo Analytics is for you. It's easy to be compliant with GDPR and other regulations while still having detailed (anonymized) analytics that help inform what content is resonating vs what content is not resonating. And of course you also get all of the rich referral, campaign, and goal conversion data to help you optimize your marketing.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
Over the top powerful Javascript enabled targeting. This feature is called DMP Profiling and is available in the Pro Plan, currently only +$100 more than the plus plan. An article explaining this feature is here for further reading: https://convert.zendesk.com/hc/en-us/articles/206631623-Target-experiment-based-on-a-custom-Javascript-condition-that-evaluates-true-at-a-later-stage. I wrote up a much longer explanation but TR broke it up weirdly. The gist is that you can powerfully use JS to target. This allows me to target users in our SPA in incredibly advanced ways. I can walk their entire history model and assign them an audience value, or I can exclude them. It's MUCH more powerful than just a "Site Area" tool. We recently used it against 900K users to check if they had written a review of their apartment or not yet. This allowed me to only expose the user on the homepage to an experiment that prompted them to write a review while excluding users that couldn't write a review from the experiment (because they had already written one). The experiment converted 50% better than what we do now, generating 9k reviews in a matter of hours.
Audience targeting IN ADDITION to all that fancy DMP targeting. This means I can define demographics or other data as a qualifier AS WELL as the previously mentioned qualifier. This can be setup in so many ways: Traffic source, Visitor Data, Include / Exclude users part of a current experiment (!!), Date/Time, Device/Browser/OS, JS Conditon
Real-time reporting that makes sense to the whole company to view. Seriously, I can share a Convert Report to any level of intelligence on my team and they understand what's happening.
Audiences and Goals are saved as presets, so your entire team can use them. Using the example above, we have an audience called "Wrote a Review" that we exclude from the Review Prompt treatments.
Their customer support is seriously fast at answering questions. I've never had to wait more than a day.
One of Piwik's strengths is the provision of customizable widgets for different bits of analytics data. The ability to add and remove them, change dates and more makes this a flexible way to visualize data.
The visitor log section is also rich, providing date, keywords, actions and more in a single table, which makes it easy to identify your most effective content.
And the visitor actions table includes both bounce rate and time on site, so you can quickly tell which pages have the most engagement.
Data display is a strength for Piwik, as you have access to overview charts while simultaneously being able to drill deeper.
We are aggressive testers and have demanding clients, and if there was any part of the Convert platform where I'd like to see improvement, it would be in the reporting section where I feel a vertical report could present in a more readable fashion to the users.
From a user security standpoint it would be useful to provide users the ability to have two-factor authentication. While stats data is not necessarily sensitive in aggregate, some users may feel that certain portions need to be more secure.
It would be nice if there was a tighter integration with the Google search/referrer API so that "keyword not defined" would be replaced more often with the actual keyword that is being used to send a visitor to a site.
An easier branding method, maybe in the form of an API function set, that pulled branding URLs from a set of database fields would be great as well.
At this point, there is not a single conceivable reason as to why we would not renew and continue to use Piwik Analytics. Especially since it is a free program and open source. The product will only get better over time as more people look into it and donate to cause so that development can continue.
To use the platform in the context of developing enhanced tests that stretch the platform there is as with most things a learning curve. However, if you're a casual user or have standard experiments that you wish to run you would be easily able to hit the ground running.
Piwik succeeds in presenting me (and my associates and my clients...) large amounts of data in a user friendly way. The interface and functionality can easily be customized. While some enhancements do need technical background (API calls by programming language from the webserver or javascript), others are easy to use (goal / event tracking)
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
The best thing about the Matomo support is that they have a forum which basically you can find the answer to almost all of your questions and most of the time you don't need to contact them regarding your questions and problems but if you need help they will answer in a reasonable time slots.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info
Convert was selected based on price point, feature set, and UI/UX. All three are very friendly to new testers and small to mid-market size companies. Their UI and tool workflow is the best out of all of the non-enterprise solutions that I have tried. There is some small room for improvement, but that only really affects power users or tests that require significant coding/development work to execute.
It is much more robust out of the box, easier to set up and more intuitive to use. The reports are set up already and it requires little to no setup after installation to start gathering insights.
Using Convert has allowed us to make quick decisions on site edits and price changes. Seeing and sharing quick results makes our operations much more profitable.
Connecting the tests with Shopify has produced very valuable and timely results that we can act upon as soon as we see statistically significant results.
A de minimis incentive was given to thank the reviewer for their time. The incentive was not used to bias or drive a particular response, nor was the incentive contingent on a positive endorsement. More Info