Likelihood to Recommend A/B Tasty tool allows us do easy testing without burdening our limited developer resources all the time. Reports are simple enough to interpret. Support has been excellent and proactive, also the onboarding was successful. It is also an advantage that we have the possibility to drive all our traffic to the test versions rather than being limited to specific user amount per month. We can recommend A/B Tasty for testing purposes, as the platform keeps it’s promises, doesn’t require too much technical knowledge and the support is excellent.
Read full review The main point of benefit is the realtime data. This is vital to our team as we are publishing a lot of content per day, so we have a busy homepage to manage and it's important to know which content is performing well. We also like to get an understanding as quickly as possible - which Chartbeat offers - of where traffic is coming from. Often we will see an example where a page is getting high traffic from Google, for example, and we know that might not need to be placed so prominently on the homepage because the traffic is arriving to us externally anyway. Without that depth of understanding what is performing best and why - updated immediately, unlike in
Google Analytics now - our homepage would not be as well optimised for users coming to us direct
Read full review Pros Customer-focused. Over the past year, AB Tasty has worked with us to overcome many obstacles (e.g. tracking hurdles, ITP issues, etc.). The team always finds a solution in a timely manner to ensure we're able to execute on experiments. Reliability. One of the biggest hurdles earlier this year were the ITP regulations set out by Apple. Over 40% of our ad traffic was Safari users. AB Tasty was using 3rd party cookies but quickly migrated over to a local session storage solution that circumvented the issue. Read full review Provides easy at-a-glance look at what people are reading right now Heads-up Display allows you to make sure the homepage is showing the content people want to read Headline testing tool provides fascinating insight into what makes people read a story and improves headline-writing ability Read full review Cons Sometimes the platform is a little glitchy and requires a refresh. Would be great to be able to see the experiments and projects on a timeline with their status and main result to have an immediate view of ongoing and completed projects. Email notification for when an experiment reaches a certain confidence level. Read full review Source of traffic needs improvement. Search and social make sense, but "internal" and "links" is a grey area. It would be helpful to define those with an organization and provide an information icon so users can easily remember what each of those buckets is tracking. More ways to customize the real-time board. For example, with video content, that's great that I can see a user has started a video, but what is the completion rate, was that only on O&O or can that track Facebook, too? Would like to see demo (age) information included as a way to slice the data so I can see what's working with my older and younger demo. Read full review Likelihood to Renew AB Tasty's tool as well as the support team completely met my goals on A/B Testing. Editing a test is really easy and AB Tasty made the marketing team free to launch nearly any test. Reporting is also easy to set up and give us the information needed to keep improving transformation on landing pages and forms
Read full review I gave Chartbeat a 5 for a renewal rating, because, while it delivers clear and understandable content, Google Analytics also provides many of the same features for free. For a small to medium website, I believe it would be more cost effective to use Google Analytics. A website with a high amount of traffic, however, could merit spending the money on Chartbeat to maximize their potential.
Read full review Usability I am able to "set it and forget it," keeping it up on my monitor for either constant checking or just keeping an eye on the numbers during the day. I'm also able to keep track of what times are perfect to post a story and which stories rack up the most traffic.
Read full review Support Rating Support is good, but it would be better if it was quicker or if AB Tasty provided a quicker SLA. At times, you require stuff urgently but AB Tasty support isn't as quick as I personally like it to be.
Read full review I have had limited experience of support for Chartbeat but whenever I have needed help it has been there. Recently there was an issue of seeing different forms of data in real time - app and otherwise effectively, and the issue was being clearly dealt with and communicated back to us.
Read full review Alternatives Considered We selected AB Tasty mostly because we got a sense that their dev and customer service teams were going to go above and beyond to help us out. We were right! The cost was also a factor as they came in a small bit lower, but cost wasn't the only factor.
Read full review Omnilytics is more robust, detailed, and catered for an intermediate media user, while I think Chartbeat is a more user-friendly and beginner-oriented piece of technology. That being said, there is an impressive amount of lift for Chartbeat, and it's evident that simplicity is the key to using a software daily (which is absolutely the point in the content world).
Read full review Return on Investment Since we use AB tasty our conversion rates have significantly increased on the Watch pages. We can report positive comments about the evolutions of our interfaces, from our expert users. And so improved customer satisfaction. The solution allows us to validate or invalidate without taking major risk while gaining in reactivity, our proposals relook pages. Commitment rates are much higher, multiplied by 2 or 3, when we implement customizations that are relevant. These customizations are very relevant insofar as we are governed by the seasonality of events as a media site. Read full review It has helped us save time in report generation and performance analysis. By helping us evaluate our contributors, we're able to get our money's worth. Seeing our numbers on the Big Board fosters healthy competition among brands, motivating us to distribute our stories better. Read full review ScreenShots