What users are saying about
23 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 9 out of 100
408 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 7.7 out of 100

Feature Set Ratings

    Testing and Experimentation

    Flurry Analytics

    Feature Set Not Supported
    N/A
    7.2

    Optimizely Web Experimentation

    72%
    Optimizely Web Experimentation ranks higher in 19/19 features

    a/b experiment testing

    N/A
    0 Ratings
    9.1
    91%
    50 Ratings

    Split URL testing

    N/A
    0 Ratings
    9.0
    90%
    39 Ratings

    Multivariate testing

    N/A
    0 Ratings
    6.9
    69%
    39 Ratings

    Multi-page/funnel testing

    N/A
    0 Ratings
    5.2
    52%
    55 Ratings

    Cross-browser testing

    N/A
    0 Ratings
    7.4
    74%
    29 Ratings

    Mobile app testing

    N/A
    0 Ratings
    8.0
    80%
    21 Ratings

    Test significance

    N/A
    0 Ratings
    8.1
    81%
    44 Ratings

    Visual / WYSIWYG editor

    N/A
    0 Ratings
    6.6
    66%
    41 Ratings

    Advanced code editor

    N/A
    0 Ratings
    6.3
    63%
    40 Ratings

    Page surveys

    N/A
    0 Ratings
    8.0
    80%
    13 Ratings

    Visitor recordings

    N/A
    0 Ratings
    7.7
    77%
    16 Ratings

    Preview mode

    N/A
    0 Ratings
    6.4
    64%
    47 Ratings

    Test duration calculator

    N/A
    0 Ratings
    7.1
    71%
    26 Ratings

    Experiment scheduler

    N/A
    0 Ratings
    7.2
    72%
    31 Ratings

    Experiment workflow and approval

    N/A
    0 Ratings
    5.7
    57%
    22 Ratings

    Dynamic experiment activation

    N/A
    0 Ratings
    6.7
    67%
    20 Ratings

    Client-side tests

    N/A
    0 Ratings
    7.5
    75%
    32 Ratings

    Server-side tests

    N/A
    0 Ratings
    8.0
    80%
    11 Ratings

    Mutually exclusive tests

    N/A
    0 Ratings
    6.0
    60%
    22 Ratings

    Audience Segmentation & Targeting

    Flurry Analytics

    Feature Set Not Supported
    N/A
    7.6

    Optimizely Web Experimentation

    76%
    Optimizely Web Experimentation ranks higher in 4/4 features

    Standard visitor segmentation

    N/A
    0 Ratings
    8.2
    82%
    46 Ratings

    Behavioral visitor segmentation

    N/A
    0 Ratings
    7.2
    72%
    34 Ratings

    Traffic allocation control

    N/A
    0 Ratings
    8.6
    86%
    44 Ratings

    Website personalization

    N/A
    0 Ratings
    6.4
    64%
    27 Ratings

    Results and Analysis

    Flurry Analytics

    Feature Set Not Supported
    N/A
    7.4

    Optimizely Web Experimentation

    74%
    Optimizely Web Experimentation ranks higher in 10/10 features

    Heatmap tool

    N/A
    0 Ratings
    7.3
    73%
    10 Ratings

    Click analytics

    N/A
    0 Ratings
    6.8
    68%
    25 Ratings

    Scroll maps

    N/A
    0 Ratings
    5.9
    59%
    14 Ratings

    Form fill analysis

    N/A
    0 Ratings
    5.5
    55%
    11 Ratings

    Conversion tracking

    N/A
    0 Ratings
    8.5
    85%
    35 Ratings

    Goal tracking

    N/A
    0 Ratings
    7.5
    75%
    40 Ratings

    Test reporting

    N/A
    0 Ratings
    9.0
    90%
    42 Ratings

    Results segmentation

    N/A
    0 Ratings
    5.4
    54%
    38 Ratings

    CSV export

    N/A
    0 Ratings
    9.5
    95%
    27 Ratings

    Experiments results dashboard

    N/A
    0 Ratings
    8.5
    85%
    37 Ratings

    Attribute Ratings

    • Flurry Analytics is rated higher in 2 areas: Likelihood to Recommend, Performance
    • Optimizely Web Experimentation is rated higher in 1 area: Likelihood to Renew

    Likelihood to Recommend

    9.0

    Flurry Analytics

    90%
    6 Ratings
    7.9

    Optimizely Web Experimentation

    79%
    133 Ratings

    Likelihood to Renew

    3.7

    Flurry Analytics

    37%
    5 Ratings
    9.0

    Optimizely Web Experimentation

    90%
    42 Ratings

    Usability

    Flurry Analytics

    N/A
    0 Ratings
    8.0

    Optimizely Web Experimentation

    80%
    57 Ratings

    Availability

    Flurry Analytics

    N/A
    0 Ratings
    9.0

    Optimizely Web Experimentation

    90%
    10 Ratings

    Performance

    10.0

    Flurry Analytics

    100%
    2 Ratings
    6.0

    Optimizely Web Experimentation

    60%
    10 Ratings

    Support Rating

    Flurry Analytics

    N/A
    0 Ratings
    9.1

    Optimizely Web Experimentation

    91%
    28 Ratings

    Online Training

    Flurry Analytics

    N/A
    0 Ratings
    3.0

    Optimizely Web Experimentation

    30%
    1 Rating

    Implementation Rating

    Flurry Analytics

    N/A
    0 Ratings
    8.0

    Optimizely Web Experimentation

    80%
    22 Ratings

    Configurability

    Flurry Analytics

    N/A
    0 Ratings
    6.0

    Optimizely Web Experimentation

    60%
    1 Rating

    Product Scalability

    Flurry Analytics

    N/A
    0 Ratings
    8.8

    Optimizely Web Experimentation

    88%
    50 Ratings

    Likelihood to Recommend

    Yahoo (Verizon Media)

    I would encourage a colleague to use Flurry Analytics. Incorporating Flurry Analytics in an app is a simple and straightforward task, and will take the average app developer less than 15 minutes to understand and apply. This amount of time is nothing in the grand scheme of the development of the app, and the return on time invested to incorporate it is great. New tracking features can be added at any time.
    Read full review

    Optimizely

    Optimizely is a great A/B testing tool for any size business. The Optimizely platform democratizes A/B testing through a simple interface, excellent training tools, easy implementation and low dependence on IT resources. Utilizing Optimizely I've been able to run robust experimentation programs with a variety of resources (acting as a 1-person team with limited access to IT resources as well as managing a team with high access to resources). Additionally, Optimizely is well-priced and positioned to be affordable for a variety of business sizes.
    Read full review

    Pros

    Yahoo (Verizon Media)

    • Flurry can track in-depth metrics across your app. This allows us to see every type of interaction our app users are performing.
    Read full review

    Optimizely

    • Optimizely makes it extremely easy to setup almost any type of split or multi-variate testing experiment. It has a variety of test triggers types & many ways to segment incoming visitors.
    • I believe Optimizely's results dashboard is one of the best among split testing software. It allowed my team to get insights into the running of tests, like time to significance and a view of metric changes over time.
    • Optimizely is very easy to use for non-engineers. It has a powerful visual interface that allows marketers and advertisers to setup complex variations without 1 line of code.
    • In terms of documentation and implementation, I believe Optimizely is ahead of its competitors in terms of its focus on reliability and speed.
    Read full review

    Cons

    Yahoo (Verizon Media)

    • There is no option to choose a timezone which will allow me to compare their data over other systems in other time zones.
    • Could be nice to have more reporting screening options.
    Read full review

    Optimizely

    • Actual creation of an A/B test is confusing and difficult (like the differences between Pages vs URLs etc.).
    • Setting up a URL Redirect Experiment is so convoluted it seems like it's not even a feature Optimizely wants you to use. Instead, it's like I'm tricking Optimizely into alternating between 2 URLs. That really needs to be cleaned up as it would be very helpful.
    Read full review

    Pricing Details

    Flurry Analytics

    Starting Price

    Editions & Modules

    Flurry Analytics editions and modules pricing
    EditionModules

    Footnotes

      Offerings

      Free Trial
      Free/Freemium Version
      Premium Consulting/Integration Services

      Entry-level set up fee?

      No setup fee

      Additional Details

      Flurry is completely free with no hidden fees. Flurry also offers support for integration, set-up and analysis.

      Optimizely Web Experimentation

      Starting Price

      Editions & Modules

      Optimizely Web Experimentation editions and modules pricing
      EditionModules

      Footnotes

        Offerings

        Free Trial
        Free/Freemium Version
        Premium Consulting/Integration Services

        Entry-level set up fee?

        No setup fee

        Additional Details

        Likelihood to Renew

        Yahoo (Verizon Media)

        Good user acquisition tracking
        Sdk integration is super easy for both iOS and Android
        Need it
        Need to support more customized dashboards / reporting (example - set up a dashboard specifically to see users engaging with a new feature recently launched)
        Read full review

        Optimizely

        Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
        Read full review

        Usability

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        Without a doubt, after 8 years using various different testing tools, Optimizely is by far the easiest to use. Feedback from developers and more technical teams has always been positive, mostly due to the code editor allowing for easy implementation along with the creation of advanced audience segments using advanced javascript. For business users and non-technical people, the wysiwig editor allows for smaller changes to be made quickly whilst somewhat educating the user on the types of code changes that are being made.
        Read full review

        Reliability and Availability

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        Web interface is nearly always available. Javascript snippet (which actually runs the test) is distributed on a CDN for near-constant availability.
        Read full review

        Performance

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        We have had some issues with screen flicker when loading experiment content. We had to dial back some of the creative changes to load smaller files.
        Read full review

        Support Rating

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
        Read full review

        Online Training

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
        Read full review

        Implementation Rating

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.
        Read full review

        Alternatives Considered

        Yahoo (Verizon Media)

        For my uses, Flurry is free which makes it way more attractive than the other platforms even on a very big number of monthly events. It also have set reports which are exactly the reports that a marketing person needs without any need of spending a developer time to create them for you, or holding an in-house BI person that works on creating reports.
        Read full review

        Optimizely

        I think that Optimizely is more user-friendly than Adobe and Monetate, for example - Adobe is really suited for people with deep pockets and a distinct technical acumen that may not be suitable for a small business. Montetate is not user-friendly - even for seasoned marketers. Apptemize is a pretty great product but they killed their free product. Like Optimzely, they seem to be shooting for enterprise-level clients.
        Read full review

        Scalability

        Yahoo (Verizon Media)

        No answers on this topic

        Optimizely

        It's all you need to design, install, analyze and measure simple tests with Optimizely. When test complexity increases, it becomes necessary to integrate third party analytics tools to perform more detailed analysis such as additional details like page views, average time spent on each page, and bounce rates by variation. Optimizely has very straightforward integrations, so integration with analytics is straightforward.
        Read full review

        Return on Investment

        Yahoo (Verizon Media)

        • Tracking the number of times a user taps a help button can help to improve the app design. Perhaps the app is not as intuitive as first thought, and improvements based upon where in the help feature a user taps will lead to improvements in the app design to make it more intuitive.
        • Tracking the number of times certain app features are used, or the amount of time spent within a given activity in the app can help to streamline an app - improve upon features that are used more frequently while eliminating less popular activities.
        • Tracking time spent within an app can give an idea as to how popular the app is.
        Read full review

        Optimizely

        • Optimizely has had a tremendous positive impact on the ROI of our clients. Whether you're just starting your testing program and just want to get your feet wet with a few simple WYSIWYG tests, or you're ready to dive in to complex MVT test designs and Personalization Campaigns, Optimizely has everything you need to create, and maintain, a highly successful testing center.
        Read full review

        Add comparison