Coremetrics / IBM Digital Analytics (discontinued) vs. UserZoom

IBM analytics has continued to improve upon the days of being the original core metrics. After using the updated version for quite some time, it has been great at providing the needed analytics to measure ROI and goal performance for our quarterly KPI's. It has resulted in a great increase in web engagements although we are a midsize company, smaller outfits may not need such an expensive option.

Incentivized

UserZoom is well suited for usability testing, I found specifically around test websites and marketing materials. I was able to invite others to participate and watch as well as screen share so that it was an interactive session. Other tools I have used have been a little better with the video output and transcripts of each session so that we could capture notes quickly, but overall it was a good tool to use to test.

Incentivized

• IBM CXA comprises an acquisition called Tealeaf. This tool has deep heritage and this is evident in its present-day capabilities.
• The Universal Behaviour Exchange or UBX puts the concept of personalisation at the forefront. The ability to combine physical (analog) and digital transactions to create the complete picture of a customer journey, is a stand out benefit.
• The solution does not have to involve the purchase of software. IBM CXA can be sold as a service bundled with analytics as a service. This not only lowers the cost of ownership, it gets around one of the principal issues. Strong staff with design and analytical capability to drive the solution and deliver tangible benefits.
• The seamless integration of Watson AI services to help with the heavy lifiting. Watson reinforces the analytical focus this solution has and can learn to recognise situations specific to a company.

Incentivized

• Quantitative testing can be done on the cheap compared to other quant tools or vendors... once you buy the license, you only pay for additional recruiting and you are managing the project, so there isn't the high cost of having other vendors doing the project management or running a survey etc.
• Farily robust means of tracking and recording data. I also relied heavily on the excel spreadsheet of all the raw data, which you can have UZ customize for you to get what you need.
• Great support system from the UserZoom team - they have researchers who can help with coding and also provide research support for a very good price.
• Also they have tree testing, card sorting, survey capabilities (in addition to usability testing)... and mobile testing. and they seem to be continously be developing the tool to support additional methods.

Incentivized

• The user interface is in Flash, which can be very frustrating and slow at times. Apparently, this is to be transitioned in a future release.
• Can only segment the last 93 days of data. Any historical segmentation beyond the 93 days must be run in Explore (which is credit based, and has its own limitations with the number of credits per month, based on the initial contract with IBM).
• Reports can only display 93 days of data at a given time for custom date ranges. There are pre-programmed date ranges setup with IBM during implementation (last week, last month, last quarter etc.), but are not flexible enough to answer more specific questions.
• Certain reports cannot have segments applied, making answering some simple questions a bit more tricky. For example, I can create a segment around mobile devices and apply it to the marketing channels report, but I can't create a marketing channel segment and apply it to the mobile reports.
• Built in API calls allows for nice report design and automation.

• Compared with some other tools, because their video conferencing platform is web-based (vs. using Zoom, which has a desktop app), I find the connection buffers a lot and it's kind of annoying
• Their screening tool on the UserZoom side (not Go) is clunky. Just let me select May, Must, or Should not for criteria rather than the weird interface design they have now.
• Logic panel is a little confusing, sometimes I do a double-take, sometimes it's wonky and resets itself. It's just not as easy to use as it could be.
• They haven't integrated UserZoom and UserZoom Go (formerly Validately)
• It's expensive!
• We signed up for a high sample size license with unlimited tests, but we're finding their panel doesn't fill as fast as their biggest competitor, UserTesting. We've struggled to fill n=100 sample tests with fairly general criteria.
• A lot of their licenses only allow limited concurrent studies, whereas UserTesting had unlimited tests that you could launch at a time. It's slowed us down.

Incentivized

IBM Digital Analytics is a great solution for our clients and I believe they offer the best solution for the retail space. We have access to IBM support via email or live chat and they can answer many of the reporting questions that come up. IBM is receptive to our feedback of the product so I am confident they will continue making improvements

I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year

Incentivized

Very easy to implement and use.

Overall, it was fairly easy to use. Especially if you are familiar with this type of product. We were able to use it for testing pretty much right after we got it (same day) and didn't have many issues figuring out how to invite, test, and share which was great.

Incentivized

Never had any issues

As reports are templated, the system is pretty quick. Sometimes you have to wait a bit for a report to render. Or you might have to re-load the page. But there is no real issue here and the system is on par with other similar systems.

Overall, the level of support is very good and I would say it is a strong asset of the solution. However, you can sometimes feel that there is a difference of level among the support team.

From my experience, the UserZoom team has really done a great job answering the limited questions we have given them thus far. I think the platform is popular enough that many of my questions have been answered by their help pages - or other online content with helpful tips and tricks. I think the community has done a nice job of providing end-user tutorials for those who are new to the platform.

Incentivized

Online training is really great. One of the best assets that they have. Lots of great videos, pop quizzes at the end of each module. Fantastic. Other tools have similar features, but not as good.

See previous comment: reading and understanding the encyclopedic implementation guide is a must.

Much of the work we did in IBM Digital Analytics could have been answered through Google Analytics, a much simpler, agile and FREE solution set. Not mention, given the vast number of Google Analytics USERS, free and actionable support is simply a click away ... this compared to IBM Digital Analytics fractured and often absent support service.

Client selected it due to how they used it, pricing, and what it could do for them. It's about the same as these other tools but UsabilityHub let's you run multiple types of task in one test, and UserTesting still has a bigger panel I think

Incentivized

This solution can support large amount of data and transaction. The way that user management features are built, it shows it is meant for large organizations.

• We spend too much time trying to work around bugs on the new UI.
• We spend too much time trying to figure out how to make certain segments work because support and the knowledge center are lackluster.
• Our sales rep is very unresponsive and leaves us searching for a lot of answers on our own, including what other products we may benefit from that IBM offers.

Incentivized

• Time-efficient: quick to gather insights
• Making informed decisions: repeat testing before launching the app/website to reduce errors in the future
• Guarantee customers' satisfaction: ensure the errors are reduced to the minimum so that the purchase process is smooth and there will be no need to reach out to our customer support team

Incentivized