Acoustic Tealeaf (formerly Acoustic Experience Analytics and before that IBM Tealeaf; Acoustic has restored the former branding), is an AI powered application providing site visitor session recording and replay, anomaly detection, and struggle analytics.
N/A
VWO
Score 8.8 out of 10
N/A
VWO is an A/B testing and conversion optimization platform that enables growing businesses to conduct qualitative and quantitative visitor research, build an experimentation roadmap and run continuous experiments on their digital properties. With its 5 capabilities Plan, Track, Test, Analyze, and Target, it brings the entire CRO (conversion rate optimization) process at one place. VWO helps online businesses follow the process- and data-driven conversion…
$49
per month
Pricing
Acoustic Tealeaf
VWO
Editions & Modules
No answers on this topic
Subscription
$99.00
per month
TESTING
Get a Demo
The classic VWO A/B testing solution
CONVERSION OPTIMIZATION
Get a Demo
The all-in-one platform for all your optimization needs
ENTERPRISE
Get a Demo
Customized solution with advanced AB testing and conversion optimization capabilities
Tealeaf is a must for any site that has a key business process that drives revenue for a company. It is not limited to only capturing a small percentage of visitors to your site, it captures every visitor to your site. A lot has changed to the last year for Tealeaf for the good. There are many more options to for capturing data including a cloud and SaaS offering. Take a look again if you haven't seen it in a while.
Our marketing team does a lot of creative testing around messaging and imagery. VWO is well suited for this type of testing and can yield great results if you define your conversion goals correctly. However, when we have tried to do more substantial/advanced changes through VWO (such as re-positioning content or modifying elements in a form), we have had some challenges and not been able to get the desired tests working correctly.
Speed of searching for web sessions and users. This particular feature seems to impress me the most. When researching incidents where users report to have difficulty on our site, all we need is any of the unique identifiers of a user (email address used, IP address, user id) and we can locate their session(s) almost immediately in TeaLeaf.
Multiple conditional events - I really like how we can have events contain already existing events. This helps a great deal if issues being researched become even more complex.
VWO has a strong support team willing to help provide answers to questions during the setup process. During setup, we had some questions regarding implementation across a significant number of sites and they were able to ease dev team concerns and provide detailed best practices to streamline integration.
Some of the initial results of a few of the initial tests raised some questions internally. We setup a call and were able to quickly address the questions and find some opportunities to leverage moving forward.
I discovered a bug within the UI that lead to some questions internally. I was able to report it and the problem was fixed rather quickly and their team followed up with a thank you for reporting it and to report the issue was now resolved.
IBM is still working out a solution for seeing Mobile App traffic in Tealeaf. What they have now allows you to see the response and request, but it doesn't show where the customer is actually clicking. They've promised that newer versions will be better with this.
Tealeaf is pushing a web based viewer, trying to make this the standard over the more robust and extremely useful desktop based Tealeaf Viewer. the Web Based viewer is slow and clunky and just not as flexible, but IBM insists on pushing customers towards it. Last I heard, they plan for their mobile solution to only work in the web based viewer.
Recently IBM moved all the support documentation for Tealeaf to the IBM Support portal instead of Tealeaf.com where it has been for years. This completely broke the in application Tealeaf Help. At the time of my last use of Tealeaf near the end of November 2013, when you tried to search help from the Tealeaf web portal, you were sent to the IBM support site, and once you logged in, the search request was lost and you had to start the search again. The search of the help files is also nowhere near as good as the original tealeaf.com help site. Also, if your users tried to use help, they were out of luck because only the Tealeaf Admins have access to the IBM support portal. At first they insisted that they were not going to fix this for older versions of the software, but instead only release a fix when the next version of Tealeaf was release. There was a large discussion about this on the LinkedIn forum and IBM has said they're working on a solution, but I'm not sure when/if that will get release.
The user interface within VWO does take a bit of time to get used to, especially as it pertains to switching back and forth between tests. When running multiple experiments on a site at a time, a clear and succinct dashboard for everything in one place would be helpful (as opposed to needing to switch between A/B, multivariate, etc).
Tealeaf is a scalable product that works with complex user-facing environments. It is one of the leading products in the market that helps identify user pain points and increases defect identification. The user interface is simple, clean, and easy to use. Lastly, Tealeaf Support provides good customer service and is eager to help solve chalenges we face along the way.
It's great value and we think we've ironed out all the major teething troubles. However, if we experience any more bugs or problems that significantly slow us down then we're seriously considering switching to Optimizely, which I haven't personally tested but have heard great things about from my CRO peers
I gave Visual Website Optimizer a rating of 8 because it is overall a great product to use. Setting up and keeping track of various tests is easy and straight forward. The only reason why this product is not rated higher is because the support documents online leave a lot of room for improvement.
VWO doesn't appear to slow down our website at all, though some customers with adblockers like UBlock Origin have been known to not see entire pages if VWO is making changes to the page at a macro level (background, font, etc). This is rare though.
While their online document support is lacking a simple email to their support team will almost always get responded to the next day. It has however taken more than one email to explain the problem to the support team till they understood the problem. The solution I was given also only half fixed the problem the rest I figured out on my own.
Training was good, just limited to the onboarding process. They walked through all of the steps it takes to get started in VWO and each of the modules, along with giving us ideas for starting our first test. I feel like it could be better if there was a guided process within the VWO program to continue to educate you along the way, and a way to turn that off for experienced users.
Overall, the implementation of VWO is straightforward. If you've got a straightforward way of deploying code to all of your test pages, either a good CMS or a TMS, then implementation should be a breeze. There is no tweaking to be done to the code itself, and once deployed it has the flexibility to cope with different VWO modules (tracking, conversion analysis, session analysis) without modification.
I used Google Optimize when it had just launched. It was therefore not yet a competitor to VWO. I haven't used it in roughly half a year time, so a lot has probably changed. I still use Hotjar for certain features that VWO offers, but which I think function better in Hotjar. I for instance prefer the Hotjar heatmaps, because I can elect to ignore certain elements on the webpage, such as a cookie consent pop up. A simple difference which makes me like Hotjar recordings more is that I can view a recording and click next, rather than going back to the overview and selecting the next recording.
The product seems infinitely scalable for our needs (small business) and we've never had any issue with loading VWO-edited elements. I will say, though, that online customers with ad blockers have been known to not see certain VWO elements as their third-party scripts are disabled.
