Google Analytics vs. Google Content Experiments (discontinued) vs. Optimizely Web Experimentation

Google Analytics is particularly well suited for tracking and analyzing customer behavior on a grocery e-commerce platform. It provides a wealth of information about customer behavior, including what products are most popular, what pages are visited the most, and where customers are coming from. This information can help the platform optimize its website for better customer engagement and conversion rates. However, Google Analytics may not be the best tool for more advanced, granular analysis of customer behavior, such as tracking individual customer journeys or understanding customer motivations. In these cases, it may be more appropriate to use additional tools or solutions that provide deeper insights into customer behavior.

Do you already have Google Analytics? If so content experiments is a good, free, starting point to dip your toes in A/B testing. Do you need to run Multivariate experiments? If so, Google Content Experiments is not going to fit your needs.

Incentivized

I think it can serve the whole spectrum of experiences from people who are just getting used to web experimentation. It's really easy to pick up and use. If you're more experienced then it works well because it just gets out of the way and lets you really focus on the experimentation side of things. So yeah, strongly recommend. I think it is well suited both to small businesses and large enterprises as well. I think it's got a really low barrier to entry. It's very easy to integrate on your website and get results quickly. Likewise, if you are a big business, it's incrementally adoptable, so you can start out with one component of optimizing and you can build there and start to build in things like data CMS to augment experimentation as well. So it's got a really strong a pathway to grow your MarTech platform if you're a small company or a big company.

Incentivized

• Multiple reports to see website use and behavior
• Allows you to customize reports with days, weeks, months, and years
• You can build out a dashboard to easily view stats from multiple websites in one place
• You can share analytics reports via the dashboard, automatically emailed PDFs or in other formats

Incentivized

• Quick and easy to create and set up experiments
• Results are presented in a way that is familiar and easy for any Google Analytics user to understand. So is great for beginners to conversion testing
• Already integrated into Google Analytics and can measure results against your existing conversion goals
• Allows nine possible variants to be A/B tested
• Features more than one testing methodology, Bayesian (Multi-Armed Bandit,) and Full Factorial
• Allows the user to select one of three possible confidence thresholds to ensure that experiment results are robust
• Great value, it is free!

• The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
• Establishing it is so simple that even a non-technical person can do it perfectly.
• It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.

Incentivized

• Data sampling is somewhat inaccurate on the free tier - this is addressed in premium but is expensive.
• Some of the UI is very similar in naming when presenting different data, some in-situ information might be useful.
• Gotchas around filtering and data validation.
• Implementation can be tricky, it can take a lot of time and expertise to get a full, accurate picture of your metrics.

Incentivized

• Their documentation is not the best and it's quite a steep learning curve.
• They also don't tell you particularly well what sorts of things you should be testing.
• Compared to other suppliers of A/B testing tools- it needs a simpler interface. Optimize is starting to answer that - but is still quite Beta-like.

Incentivized

• JavaScript is hard to implement sometimes especially for JQuery elements
• ROI reporting should be part of the overall experimentation reporting
• CMP integration: where we can easily show status of test on the HPT request
• CMS integration
• More widgets like social proof banners, etc.

Incentivized

We will continue to use Google Analytics for several reasons. It is free, which is a huge selling point. It houses all of our ecommerce stores' data, and though it can't account for refunds or fraud orders, gives us and our clients directional, real time information on individual and group store performance.

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

I rated this question because at this stage, Optimizely does most everything we need so I don't foresee a need to migrate to a new tool. We have the infrastructure already in place and it is a sizeable lift to pivot to another tool with no guarantee that it will work as good or even better than Optimizely

Incentivized

Google Analytics provides a wealth of data, down to minute levels. That is it's greatest detriment: find the right information when you need it can be a cumbersome task. You are able to create shortcuts, however, so it can mitigate some of this problem. Google is continually refining Analytics, so I do not doubt there will be improvements

Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.

Incentivized

We all know Google is at top when it comes to availability. We have never faced any such instances where I can suggest otherwise. All you need is a Google account, a device and internet connection to use this super powerful tool for reporting and visualising your site data, traffic, events, etc. that too in real time.

I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

This has been a catalyst for improving our site's traffic handling capabilities. We were able to identify exit% from our sites through it and we used recommendations to handle and implement the same in our sites. We have been increasing the usage of Google Analytics in our sites and never had any performance related issues if we used Analytics

I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

The Google reps respond very quickly. However, sometimes they can overly call you to set up an apportionment. I'm very proficient and sometimes when I talk to reps, they give beginner tutorials and insights that are a waste of time. I wish Google would understand my level of expertise and assign me to a rep (long-term) that doesn't have to walk me through the basics.

Incentivized

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.

love the product and training they provide for businesses of all sizes. The following list of links will help you get started with Google Analytics from setup to understanding what data is being presented by Google Analytics.

1. How to Use Google Analytics for Beginners – Mahalo’s how-to guide for beginners.
2. A beginner’s guide to Google Analytics – A free eBook walking you through Google Analytics from setup to understanding what data is being presented.
3. Getting to Know Your Google Analytics Dashboard – The title says it all! This is a brief post with one goal: to introduce you to the Google Analytics dashboard.
4. Google Analytics for Beginners: How to Make the Most of Your Traffic Reports– This guide doesn’t cover setup, but it does a great job of helping you to better understand the data being presented.
5. Google Analytics Video Tutorial 1: Setup – A video presentation that walks you through Google Analytics setup.
6. Google Analytics Video Tutorial 2: Essential Stats – A video presentation that introduces you to some of the most important data being presented in Google Analytics.

The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).

I think my biggest take away from the Google Analytics implementation was that there needs to be a clear understanding of what you want to achieve and how you want to achieve it before you start. Originally the analytics were added to track visitors, but as we became more savvy with the product, we began adding more and more functionality, and defining guidelines as we went along. While not detrimental to our success, this lack of an overarching goal resulted in some minor setbacks in implementation and the collection of some messy data that is unusable.

In retrospect: - I think I should have stressed more demo's / workshopping with the Optimizely team at the start. I felt too confident during demo stages, and when came time to actually start, I was a bit lost. (The answer is likely I should have had them on-hand for our first install.. they offered but I thought I was OK.) - Really getting an understanding / asking them prior to install of how to make it really work for checkout pages / one that uses dynamic content or user interaction to determine what the UI does. Could have saved some time by addressing this at the beginning, as some things we needed to create on our site for Optimizely to "use" as a trigger for the variation test. - Having a number of planned/hoped-for tests already in-hand before working with Optimizely team. Sharing those thoughts with them would likely have started conversations on additional things we needed to do to make them work (rather than figuring that out during the actual builds). Since I had development time available, I could have added more things to the baseline installation since my developers were already "looking under the hood" of the site.

I have not used Adobe Analytics as much, but I know they offer something called customer journey analytics, which we are evaluating now. I have used Semrush, and I find them much better than Google Analytics. I feel a fairly nontechnical person could learn Semrush in about a month. They also offer features like competitive analysis (on content, keywords, traffic, etc.), which is very useful. If you have to choose one among Semrush and Google Analytics, I would say go for Semrush.

Incentivized

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you need to confidently make changes

Incentivized

Google Analytics is currently handling the reporting and tracking of near about 80 sites in our project. And I am not talking about the sites from different projects. They may have way more accounts than that. Never ever felt a performance issue from Google's end while generating or customising reports or tracking custom events or creating custom dimensions

We can use it flexibly across lines of business and have it in use across two departments. We have different use cases and slightly different outcomes, but can unify our results based on impact to the bottom line. Finally, we can generate value from anywhere in the org for any stakeholders as needed.

Incentivized

• It has helped us gain understanding of what is going on on our website.
• It has helped us determine areas that need fixing (i.e. pages with extremely high bounce rates may need to be redone).
• It has helped us understand our biggest avenues for bringing traffic to the website and business in general.
• It has helped guide our website redesign.

Incentivized

• CE has made efficient time use easy and fool-proof when it comes to learning the software
• Because it integrates with other Google programs there is a benefit to track with Google Analytics
• The learning curve can create initiate time investment that may go beyond what companies are willing to dedicate.

• We're able to share definitive annualized revenue projections with our team, showing what would happen if we put a test into Production
• Showing the results of a test on a new page or feature prior to full implementation on a site saves developer time (if a test proves the new element doesn't deliver a significant improvement.
• Making a change via the WYSIWYG interface allows us to see multiple changes without developer intervention.

Incentivized