Best A/B test tool
June 05, 2014
Best A/B test tool
Score 10 out of 10
Vetted Review
Verified User
Overall Satisfaction with AB Tasty
AB Tasty is being used by the whole organization. It helps all project and product managers to optimise the website by taking the good decisions, and explain their choices to the top management with accurate data. It can be used either to optimise small elements (e.g. colors, placements...) or major features. AB Tasty is used continuously, in order to make sure there's always an element of the website being tested and optimised. Not using AB Tasty for a small period means not optimising our pages/features, and thus means losing money.
- Great editing tool : we can directly edit changes within the AB Tasty editing tool, without using the development team.
- Great reporting tool : we can understand very quickly how well the test performed. Main KPIs are visible at a glance, with percentage of improvements, and with the ability to apply filters to understand better.
- Test the same element on different pages : we can optimise a specific element present in many pages such as the header, which is very useful (many A/B tests platforms allows only to compare 2 pages).
- Segment the test : ability to apply a test on specific criteria, such as new visitors, mobile users, etc.
- Speed of the reporting tool : the reporting tool can be quite slow, especially when we try to apply filters or when a lot of visitors viewed the test.
- Ease of use of the editing tool : the editing tool can be a bit complicated sometimes to use if we didn't get training. Sometimes the behaviour is not the expected one (for example : insert an image then a link on it, the position of the image sometimes changes).
- Heatmap : I don't know how confident I can be with the heatmap data. It doesn't seem to be a major tool of AB Tasty, however it can be very useful.
- Increase conversion rate and revenue
- Reduce conflicts inside the company (should the button be green or red?)
- Gain time of development : some changes can be made directly in the tool, and once the variation is validated, we can apply it for all users directly via the tool, to give the time to the developers to develop it.
I've tested Google Analytics A/B testing solution, however here's why I prefer AB Tasty:
- the set up of a test is easier and faster on AB Tasty (doesn't require technical skills)
- Google Analytics doesn't allow you to apply a test across several pages (e.g. the header), whereas AB Tasty allows it
- the set up of a test is easier and faster on AB Tasty (doesn't require technical skills)
- Google Analytics doesn't allow you to apply a test across several pages (e.g. the header), whereas AB Tasty allows it