Methodology

The TrustMap™ compares Business Intelligence software products, based on end-user satisfaction ratings and research frequency. The question of how to bound the BI space is always difficult. Although this guide talks about a broad range of topics and products that are related to BI, the focus is firmly on products that are designed to take operational and other corporate or external data and analyze it in order to make decisions and provide strategic guidance to the business. Although they are discussed in the guide, technologies like data warehouses, Hadoop-related storage technologies, data blending tools, and functionally specific tools like pipeline analysis products for sales, are not included on the TrustMaps, nor are there product profiles for these products.

To be included in this guide and on a particular TrustMap™, a product must have at least 15 reviews overall, and at least 5 reviews and ratings in that segment. Additionally, at least 15% of the product's ratings and reviews must come from reviewers in that segment (to show sufficient segment focus).

For this guide, we have segmented data by the size of the company using the product, based on number of employees. Our market segments are:

  • Small Businesses: 1-50 employees
  • Mid-Size Companies: 51-1,000 employees
  • Enterprises: More than 1,000 employees

We have created each TrustMap on two dimensions:

  1. trScore: The overall ‘likelihood to recommend’ rating - a representation of overall satisfaction - by users who have written reviews on TrustRadius.
  2. Research Frequency: This metric reflects how often a product is researched by prospective buyers on TrustRadius. It is measured by monthly unique page views of pages associated with a given product, including product descriptions, reviews and comparisons. Products with large installed bases or those experiencing significant growth momentum are evaluated more frequently.

The red dotted line depicts the median user rating. All products above the red line are classified as “Top Rated”. Products further to the right on the graphic are those products that are most frequently searched for on TrustRadius. High search volumes may indicate either positive or negative sentiment – people evaluating a product either to select or replace.

About TrustRadius reviews
All of the reviews on TrustRadius are from authenticated end-users of the product. Before a review is published, a TrustRadius researcher verifies each reviewer's LinkedIn profile to ensure they are a real user, and vets the review itself to ensure it offers detailed insights about the product. TrustRadius will not publish any review from a vendor's current or former employees or those of any competitors.

In addition to checking the quality and legitimacy of each individual review, TrustRadius is also focused on making sure our data is representative. Vendor-led efforts to invite only known promoters to review them can artificially inflate average ratings and introduce a positive selection bias. Thus, rather than using a simple average for ratings, we have developed a more meaningful, weighted average called the trScore. More information on how the trScore works can be found here.

TrustRadius acquires reviews in a few different ways, including:

  • Direct Outreach: TrustRadius scours the Internet, identifies potential reviewers with experience in products of interest, and reaches out directly.
  • Community Contribution: Those who have used TrustRadius to research software products give back to the community by writing their own review.
  • Vendor Solicitation: Some vendors invite their own customers to write reviews. These reviews are marked “Invited by: Vendor” on TrustRadius. When vendors introduce positive selection bias by inviting only known advocates to write reviews, our trScore adjusts for this bias.
  • Review Programs: TrustRadius offers paid review management programs where TrustRadius works with vendors directly to invite their customer base to review them on TrustRadius. These reviews are subject to the same rules and procedures as any other reviews on TrustRadius, and subject to the same trScore requirements in terms of sample representativeness.
  • In many cases, small incentives are used to increase broad participation and motivate reviewers to write more comprehensive, in-depth reviews. TrustRadius has found that the use of incentives yields reviews from a more diverse set of users (e.g., beyond strong advocates or detractors). Incentives are never tied to a particular response in the review. More information on TrustRadius reviews can be found here.

Beyond ratings
Satisfaction ratings are one factor to consider in your search for a BI solution. It's also important to consider your feature requirements and the particular strengths and weaknesses of each product. The rest of this report provides an evaluation of each software product, including pros and cons, customer demographics, and other insights gleaned from end-user reviews on TrustRadius.