Airship vs. Optimizely Web Experimentation

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Airship
Score 9.0 out of 10
N/A
The Airship Experience Platform provides an end-to-end solution for unifying experiences across channels and capturing value across the entire customer lifecycle.N/A
Optimizely Web Experimentation
Score 8.7 out of 10
N/A
Whether launching a first test or scaling a sophisticated experimentation program, Optimizely Web Experimentation aims to deliver the insights needed to craft high-performing digital experiences that drive engagement, increase conversions, and accelerate growth.N/A
Pricing
AirshipOptimizely Web Experimentation
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
AirshipOptimizely Web Experimentation
Free Trial
YesYes
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeOptionalOptional
Additional Details
More Pricing Information
Community Pulse
AirshipOptimizely Web Experimentation
Considered Both Products
Airship
Chose Airship
They are the only Application/Push vendor we have used since I started w/ the company about 4 years ago. I believe we have sued them since 2016 or so.
Chose Airship
Airship allows for more uses for a better value and is more of a focused outreach for the parishioners, and much easier to use with mobile devises.
Chose Airship
We've tested a bunch of different CRM tools over the years and Airship has been a winner for its functionality, features, cost, and ability to integrate with other softwares that we use. It has been great for SMS and mobile in particular. It could certainly be a one stop shop …
Chose Airship
Airship have a very different set of features, we could not find an exact match of it.
Chose Airship
Easy user interface and seamless integration. Great Customer engagement
Chose Airship
Airship allows for more uses for a better value and is more of a focused outreach for the parishioners, and much easier to use with mobile devises.
Chose Airship
We use Sailthru for emails. We have not used them for pushes so I can't compare the two.
Chose Airship
The above mentioned products were evaluated for initial RFQ process however Airship was awarded for the robustness and ease of use, and its strategy aligns with Vodafone's App usage engagement
Chose Airship
Airship is superb in customer support against all others. Even though I feel CleverTap may be a better choice but probably will not be as easy as Airship when setting them up and operating it. As for MoEngage, the last experience I had was simply not good enough, but that was …
Chose Airship
I have also worked with Vibes, Salesforce, Pendo, and Swrve for mobile app marketing efforts, and I always come back to airship as delivering the best Push and In-App messaging capabilities. If you want a full service platform for Push and In-App messaging rather than …
Chose Airship
There was a time when we went off Urban Airship and went to Spreed. We were using Spreed's app, so there was much better integration on push notifications. The push notification took readers directly into the story. When we moved from Spreed to our own native app, we went back …
Optimizely Web Experimentation
Chose Optimizely Web Experimentation
Atlassian Jira
Chose Optimizely Web Experimentation
We have just used experimentation just now, so we don't have any other tools or products.
Chose Optimizely Web Experimentation
I'm new to Experimentations. This is the only product that I've used.
Chose Optimizely Web Experimentation
Optmizely is much more performant product. We have witnessed less issues with page performance on Optimizely and have no issues with flickering. We had these issues with Maxymiser.
Chose Optimizely Web Experimentation
Contentsquare and Sitecore Digital Experience Platform
Chose Optimizely Web Experimentation
Best-in-Class Experiment Design compared to platforms like VWO and Convert. Optimizely offers a more polished and intuitive UI for setting up experiments. It feels purpose-built with lots of concurrent tests. Features like traffic allocation, audience targeting, and variation …
Chose Optimizely Web Experimentation
The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you …
Chose Optimizely Web Experimentation
I do not have any issues with AB Tasty. They are great. We went with Optimizely because they have several other products that will work together with our business model. Optimizely has grown and it now offers many other products that work with experimentation like CMS, CMP, ODP …
Chose Optimizely Web Experimentation
Google Optimize and Hotjar
Chose Optimizely Web Experimentation
Optimizely is highly intuitive, allowing marketers or non-technical folks to run experiments without complicated coding. It also allows for various types of experimentation, including A/B tests, multivariate tests, and personalization. This capability will enable teams to run …
Chose Optimizely Web Experimentation
Better UI, more integrated with our enterprise
Chose Optimizely Web Experimentation
This is a platform that was already implemented when I started with my current company.
Chose Optimizely Web Experimentation
The feature set and ecosystem for Optimizely seemed much more robust and scalable.
Chose Optimizely Web Experimentation
None of them have a best in class stats engine and live within an ecosystem of marketing technology products the way that Optimizely does, so the scalability of using any one of those tools is limited as compared to using Optimizely Web Experimentation.
Chose Optimizely Web Experimentation
It's a lot more, well, site stacked, it's way better than that. Adobe Target. I think the UI is easier to use on Optimizely. The one thing that I would say comparatively is our analytics talking to each other. Obviously Adobe, we use Adobe Analytics and Adobe Target, so they …
Chose Optimizely Web Experimentation
Optimizely is more user-friendly and cost-effective, ideal for experimentation-focused teams, while Adobe Target excels in advanced personalization and seamless integration within the Adobe ecosystem, making it better suited for large enterprises.
Chose Optimizely Web Experimentation
We analyzed a few competitors and optimizely had the most robust feature set and scalability
Chose Optimizely Web Experimentation
I feel Optimizely Web Experimentation stacked up well against Split
Chose Optimizely Web Experimentation
We haven't used other Optimizely products apart from Web Experimentation.
Chose Optimizely Web Experimentation
Optimizely Web Experimentation was more robust and able to handle the broad array of sites we run than VWO. It has been a great platform to easily add additional sites onto, but still providing a universal overview of all of them, making management a simple task.
Chose Optimizely Web Experimentation
we used Optimizely Web Experimentation then AB Tasty but came back to Optimizley because of its robust stat sig and features as well as all of the products we will be able to work in synchronization.
Chose Optimizely Web Experimentation
We use both, it just depends on the use case. I personally prefer feature experimentation but I see why both are useful.
Chose Optimizely Web Experimentation
Optimizely Web Experimentation has more robust product for experimentation specialists than VWO
Features
AirshipOptimizely Web Experimentation
Testing and Experimentation
Comparison of Testing and Experimentation features of Product A and Product B
Airship
-
Ratings
Optimizely Web Experimentation
8.0
Ratings
5% below category average
a/b experiment testing00 Ratings9.00 Ratings
Split URL testing00 Ratings8.50 Ratings
Multivariate testing00 Ratings8.40 Ratings
Multi-page/funnel testing00 Ratings7.90 Ratings
Cross-browser testing00 Ratings8.10 Ratings
Mobile app testing00 Ratings8.00 Ratings
Test significance00 Ratings8.40 Ratings
Visual / WYSIWYG editor00 Ratings8.10 Ratings
Advanced code editor00 Ratings8.00 Ratings
Page surveys00 Ratings6.20 Ratings
Visitor recordings00 Ratings8.40 Ratings
Preview mode00 Ratings7.60 Ratings
Test duration calculator00 Ratings7.90 Ratings
Experiment scheduler00 Ratings8.20 Ratings
Experiment workflow and approval00 Ratings7.80 Ratings
Dynamic experiment activation00 Ratings7.50 Ratings
Client-side tests00 Ratings7.80 Ratings
Server-side tests00 Ratings7.20 Ratings
Mutually exclusive tests00 Ratings8.10 Ratings
Audience Segmentation & Targeting
Comparison of Audience Segmentation & Targeting features of Product A and Product B
Airship
-
Ratings
Optimizely Web Experimentation
8.2
Ratings
7% below category average
Standard visitor segmentation00 Ratings8.40 Ratings
Behavioral visitor segmentation00 Ratings7.60 Ratings
Traffic allocation control00 Ratings9.10 Ratings
Website personalization00 Ratings7.80 Ratings
Results and Analysis
Comparison of Results and Analysis features of Product A and Product B
Airship
-
Ratings
Optimizely Web Experimentation
8.3
Ratings
4% below category average
Heatmap tool00 Ratings9.30 Ratings
Click analytics00 Ratings8.80 Ratings
Scroll maps00 Ratings8.50 Ratings
Form fill analysis00 Ratings8.00 Ratings
Conversion tracking00 Ratings8.70 Ratings
Goal tracking00 Ratings8.20 Ratings
Test reporting00 Ratings7.90 Ratings
Results segmentation00 Ratings7.70 Ratings
CSV export00 Ratings7.90 Ratings
Experiments results dashboard00 Ratings8.00 Ratings
Best Alternatives
AirshipOptimizely Web Experimentation
Small Businesses
OneSignal
OneSignal
Score 8.0 out of 10
Convert Experiences
Convert Experiences
Score 9.9 out of 10
Medium-sized Companies
Flurry Analytics (discontinued)
Flurry Analytics (discontinued)
Score 9.0 out of 10
Dynamic Yield
Dynamic Yield
Score 9.0 out of 10
Enterprises
Flurry Analytics (discontinued)
Flurry Analytics (discontinued)
Score 9.0 out of 10
Dynamic Yield
Dynamic Yield
Score 9.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
AirshipOptimizely Web Experimentation
Likelihood to Recommend
8.9
(0 ratings)
8.7
(0 ratings)
Likelihood to Renew
-
(0 ratings)
9.5
(0 ratings)
Usability
6.0
(0 ratings)
10.0
(0 ratings)
Availability
-
(0 ratings)
10.0
(0 ratings)
Performance
-
(0 ratings)
7.3
(0 ratings)
Support Rating
9.0
(0 ratings)
10.0
(0 ratings)
Online Training
-
(0 ratings)
3.0
(0 ratings)
Implementation Rating
-
(0 ratings)
8.0
(0 ratings)
Configurability
-
(0 ratings)
6.0
(0 ratings)
Product Scalability
-
(0 ratings)
8.0
(0 ratings)
User Testimonials
AirshipOptimizely Web Experimentation
Likelihood to Recommend
Well-Suited for: 1. Mobile App Notifications: Ideal for targeted push notifications in apps. 2. Customer Segmentation: Effective for personalized marketing campaigns based on user data. 3. Event-Triggered Automation: Great for automated messaging based on user actions. 4. A/B Testing: Useful for optimizing campaign messages and strategies. Less Appropriate for: 1. Non-Mobile Channels: Less effective if the primary focus is on non-mobile communications like email or direct mail. 2. Basic Email Marketing: Other platforms might be better suited for simple, broad email campaigns without complex segmentation or personalization needs.
Read full review
I think it can serve the whole spectrum of experiences from people who are just getting used to web experimentation. It's really easy to pick up and use. If you're more experienced then it works well because it just gets out of the way and lets you really focus on the experimentation side of things. So yeah, strongly recommend. I think it is well suited both to small businesses and large enterprises as well. I think it's got a really low barrier to entry. It's very easy to integrate on your website and get results quickly. Likewise, if you are a big business, it's incrementally adoptable, so you can start out with one component of optimizing and you can build there and start to build in things like data CMS to augment experimentation as well. So it's got a really strong a pathway to grow your MarTech platform if you're a small company or a big company.
Read full review
Pros
  • Setting up the target audience within Airship using attributes is one of my favorites.
  • Airship has a very user-friendly interface with detailed documentation for self-help. I also enjoy the training sessions, articles and reports Airship organized as those are very insightful and useful.
Read full review
  • The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
  • Establishing it is so simple that even a non-technical person can do it perfectly.
  • It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.
Read full review
Cons
  • The automated A/B testing winner selection and application should be added
  • The flexibility of message shape, specifically incorporating transparency so messages do not need to be a rectangular shape
  • Faster and more reliable servers around the globe
  • Making more detailed use cases and tutorials to be followed can simplify things for users
Read full review
  • The results view is dense and difficult to package easily for leadership, and when filtering by segment it's hard to read comparative outcomes without clearing or swapping filters
  • The organization of experiments and statuses is a cluttered list and the search is limited in use - would love to see that improve with time
  • There are so many other MarTech products out there, would love to see more dedicated integrations so we don't have to invest in something like Zapier or Tray to build hacky automations
Read full review
Likelihood to Renew
No answers on this topic
Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.
Read full review
Usability
The interface takes a bit getting used to in order to know how to take advantage of everything. Some of the analytics that are available are particularly hard to find, so it's important to pay attention when customer support reviews everything, but everything I'd want and need in terms of Push and In-App messaging is all there.
Read full review
Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.
Read full review
Reliability and Availability
No answers on this topic
I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review
Performance
No answers on this topic
I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
Read full review
Support Rating
I have not had to interact much with customer support as I have been able to find the vast majority of the answers I'm looking for within their documentation, which I very much appreciate because it saves me a lot of time. Customer support has been responsive and helpful for the most part during the couple of interactions I've had.
Read full review
They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
Read full review
Online Training
No answers on this topic
The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).
Read full review
Implementation Rating
No answers on this topic
The implementation through the tag management system took a bit of trial and error at first, mostly due to the asynchronous nature of the TMS. We had to manipulate the implementation to assure that the Optimizely code was written to the page at the right time to allow the experiment content load in the browser without showing any of the original content first. We also needed to make some adjustments to the TMS code to get the integration with Site Catalyst timed appropriately.
Read full review
Alternatives Considered
I have also worked with Vibes, Salesforce, Pendo, and Swrve for mobile app marketing efforts, and I always come back to airship as delivering the best Push and In-App messaging capabilities. If you want a full service platform for Push and In-App messaging rather than configuring these channels through something that is no cost such as Firebase, then i would recommend Airship.
Read full review
The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you need to confidently make changes
Read full review
Scalability
No answers on this topic
It's incredibly flexible and adapts well to organizations of all sizes, whether you’re running a single site or managing multiple departments and platforms. The ability to deploy experiments seamlessly across different environments is a huge plus, especially for growing businesses. While it’s highly scalable, the last point would depend on the right team leveraging its full potential.
Read full review
Return on Investment
  • The ROI has increased more than approx. 50% (exact details to be confirmed) based on cross-channel orchestration
  • Using push notifications alone, we have seen a huge increase in app engagement which was a challenge before to nudge users to get back to the App after initial download
Read full review
  • we saved money by not implementing certain copy/design
  • we learned that customers from different states react different to a variation
  • we are slowly learning where conversion happens and where to fix the frictions
  • Testing shorter vs longer journeys increased funnel conversion in some states - we avoided implementing this nationwide
Read full review
ScreenShots

Airship Screenshots

Screenshot of Screenshot of Screenshot of

Optimizely Web Experimentation Screenshots

Screenshot of AI-Powered Experimentation with Opal:

- Instant Test Ideas: Generates high-quality A/B test ideas based on any goals and audience insights.
- Smarter Experimentation: The AI can suggest impactful variations, reducing guesswork and increasing test velocity.
- More Than Just Ideas: From hypothesis generation to analyzing results, Opal helps optimize every stage of the experimentation process.Screenshot of the new Visual Editor with an AI Variation Development Agent

Create simple or advanced website changes fast without writing a line of code with our AI Development Agent.

Use natural language to build out your ideas and apply brand styles to your experiments instantly.Screenshot of Advanced Audience Targeting:

- Delivers personalized experiences by targeting users based on behaviors, attributes, and real-time conditions.
- Defines precise audience segments using first-party data, geolocation, and device type.
- Can test and optimize for different audience groups to maximize impact and engagement.Screenshot of Variation Template

Library of experience templates that you can access right within the Visual Editor. Customize these templates or create your own to easily reuse throughout your experimentation program.

- Offers pre-built templates for common test setups.
- Standardized variations and maintains brand integrity with reusable templates.
- Templates can be customized visually or tweak them with code for full flexibility.Screenshot of Web Experimentation Results Page:

- Data visualizations help interpret experiment performance.
- Displays which variations are winning with built-in statistical significance calculations.
- Results can be filtered by audience segments, events, and conversions to uncover key trends.Screenshot of the custom code editor for JavaScript & CSS changes, used to build complex tests.