Frosmo vs. Optimizely Feature Experimentation

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Frosmo
Score 7.0 out of 10
N/A
Frosmo includes tools for precise user segmentation with various rules and combinations that can cover any requirements (and customization options as well), MVT testing with a special control group method, full website personalization without any work from the IT deparment, conversion tracking, conversion optimization, as well as targeting and re-targeting via ad campaigns, that are created within the product, using the same user segments. Integration via JavaScript.N/A
Optimizely Feature Experimentation
Score 8.2 out of 10
N/A
Optimizely Feature Experimentation unites feature flagging, A/B testing, and built-in collaboration—so marketers can release, experiment, and optimize with confidence in one platform.N/A
Pricing
FrosmoOptimizely Feature Experimentation
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
FrosmoOptimizely Feature Experimentation
Free Trial
YesNo
Free/Freemium Version
YesYes
Premium Consulting/Integration Services
YesYes
Entry-level Setup FeeNo setup feeRequired
Additional Details
More Pricing Information
Community Pulse
FrosmoOptimizely Feature Experimentation
Features
FrosmoOptimizely Feature Experimentation
Testing and Experimentation
Comparison of Testing and Experimentation features of Product A and Product B
Frosmo
7.5
1 Ratings
11% below category average
Optimizely Feature Experimentation
-
Ratings
a/b experiment testing7.01 Ratings00 Ratings
Split URL testing8.01 Ratings00 Ratings
Multivariate testing7.01 Ratings00 Ratings
Multi-page/funnel testing7.01 Ratings00 Ratings
Cross-browser testing8.01 Ratings00 Ratings
Mobile app testing7.01 Ratings00 Ratings
Test significance7.01 Ratings00 Ratings
Visual / WYSIWYG editor8.01 Ratings00 Ratings
Advanced code editor8.01 Ratings00 Ratings
Page surveys6.01 Ratings00 Ratings
Visitor recordings7.01 Ratings00 Ratings
Preview mode8.01 Ratings00 Ratings
Test duration calculator8.01 Ratings00 Ratings
Experiment scheduler7.01 Ratings00 Ratings
Experiment workflow and approval8.01 Ratings00 Ratings
Dynamic experiment activation9.01 Ratings00 Ratings
Client-side tests8.01 Ratings00 Ratings
Server-side tests7.01 Ratings00 Ratings
Mutually exclusive tests8.01 Ratings00 Ratings
Audience Segmentation & Targeting
Comparison of Audience Segmentation & Targeting features of Product A and Product B
Frosmo
7.5
1 Ratings
15% below category average
Optimizely Feature Experimentation
-
Ratings
Standard visitor segmentation8.01 Ratings00 Ratings
Behavioral visitor segmentation7.01 Ratings00 Ratings
Traffic allocation control8.01 Ratings00 Ratings
Website personalization7.01 Ratings00 Ratings
Results and Analysis
Comparison of Results and Analysis features of Product A and Product B
Frosmo
7.4
1 Ratings
15% below category average
Optimizely Feature Experimentation
-
Ratings
Heatmap tool7.01 Ratings00 Ratings
Click analytics7.01 Ratings00 Ratings
Scroll maps7.01 Ratings00 Ratings
Form fill analysis8.01 Ratings00 Ratings
Conversion tracking8.01 Ratings00 Ratings
Goal tracking7.01 Ratings00 Ratings
Test reporting7.01 Ratings00 Ratings
Results segmentation8.01 Ratings00 Ratings
CSV export7.01 Ratings00 Ratings
Experiments results dashboard8.01 Ratings00 Ratings
Best Alternatives
FrosmoOptimizely Feature Experimentation
Small Businesses
Convert Experiences
Convert Experiences
Score 9.9 out of 10
GitLab
GitLab
Score 8.6 out of 10
Medium-sized Companies
Dynamic Yield
Dynamic Yield
Score 8.9 out of 10
GitLab
GitLab
Score 8.6 out of 10
Enterprises
Dynamic Yield
Dynamic Yield
Score 8.9 out of 10
GitLab
GitLab
Score 8.6 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
FrosmoOptimizely Feature Experimentation
Likelihood to Recommend
7.0
(1 ratings)
8.3
(48 ratings)
Likelihood to Renew
-
(0 ratings)
4.5
(2 ratings)
Usability
-
(0 ratings)
7.7
(27 ratings)
Support Rating
-
(0 ratings)
3.6
(1 ratings)
Implementation Rating
-
(0 ratings)
10.0
(1 ratings)
Product Scalability
-
(0 ratings)
5.0
(1 ratings)
User Testimonials
FrosmoOptimizely Feature Experimentation
Likelihood to Recommend
Frosmo Ltd
It was SO easy getting started. The fact that I was led through a step-by-step process when first joining was a GAME CHANGER. I have found it pretty easy to use for editing or creating email campaigns. It's good value for your buck!
Read full review
Optimizely
Based on my experience with Optimizely Feature Experimentation, I can highlight several scenarios where it excels and a few where it may be less suitable. Well-suited scenarios: - Multi-Channel product launches - Complex A/B testing and feature flag management - Gradual rollout and risk mitigation Less suited scenarios: - Simple A/B tests (their Web Experimentation product is probably better for that) - Non-technical team usage -
Read full review
Pros
Frosmo Ltd
  • The RSS Email Campaign feature.
  • It is simple, intuitive, and easy to use.
  • The templates they have to create a campaign are great.
  • Dashboard is easy to understand.
Read full review
Optimizely
  • It is easy to use any of our product owners, marketers, developers can set up experiments and roll them out with some developer support. So the key thing there is this front end UI easy to use and maybe this will come later, but the new features such as Opal and the analytics or database centric engine is something we're interested in as well.
Read full review
Cons
Frosmo Ltd
  • Importing contacts is still buggy.
  • Customers on the free plan have restricted access to customer service.
Read full review
Optimizely
  • Would be nice to able to switch variants between say an MVT to a 50:50 if one of the variants is not performing very well quickly and effectively so can still use the standardised report
  • Interface can feel very bare bones/not very many graphs or visuals, which other providers have to make it a bit more engaging
  • Doesn't show easily what each variant that is live looks like, so can be hard to remember what is actually being shown in each test
Read full review
Likelihood to Renew
Frosmo Ltd
No answers on this topic
Optimizely
Competitive landscape
Read full review
Usability
Frosmo Ltd
No answers on this topic
Optimizely
Easy to navigate the UI. Once you know how to use it, it is very easy to run experiments. And when the experiment is setup, the SDK code variables are generated and available for developers to use immediately so they can quickly build the experiment code
Read full review
Support Rating
Frosmo Ltd
No answers on this topic
Optimizely
Support was there but it was pretty slow at most times. Only after escalation was support really given to our teams
Read full review
Implementation Rating
Frosmo Ltd
No answers on this topic
Optimizely
It’s straightforward. Docs are well written and I believe there must be a support. But we haven’t used it
Read full review
Alternatives Considered
Frosmo Ltd
No answers on this topic
Optimizely
When Google Optimize goes off we searched for a tool where you can be sure to get a good GA4 implementation and easy to use for IT team and product team. Optimizely Feature Experimentation seems to have a good balance between pricing and capabilities. If you are searching for an experimentation tool and personalization all in one... then maybe these comparison change and Optimizely turns to expensive. In the same way... if you want a server side solution. For us, it will be a challenge in the following years
Read full review
Scalability
Frosmo Ltd
No answers on this topic
Optimizely
had troubles with performance for SSR and the React SDK
Read full review
Return on Investment
Frosmo Ltd
  • It helps me reach out to prospective clients every day
Read full review
Optimizely
  • We have a huge, noteworthy ROI case study of how we did a SaaS onboarding revamp early this year. Our A/B test on a guided setup flow improved activation rates by 20 percent, which translated to over $1.2m in retained ARR.
Read full review
ScreenShots

Optimizely Feature Experimentation Screenshots

Screenshot of Feature Flag Setup. Here users can run flexible A/B and multi-armed bandit tests, as well as:

- Set up a single feature flag to test multiple variations and experiment types
- Enable targeted deliveries and rollouts for more precise experimentation
- Roll back changes quickly when needed to ensure experiment accuracy and reduce risks
- Increase testing flexibility with control over experiment types and delivery methodsScreenshot of Audience Setup. This is used to target specific user segments for personalized experiments, and:

- Create and customize audiences based on user attributes
- Refine audience segments to ensure the right users are included in tests
- Enhance experiment relevance by setting specific conditions for user groupsScreenshot of Experiment Results, supporting the analysis and optimization of experimentation outcomes. Viewers can also:

- examine detailed experiment results, including key metrics like conversion rates and statistical significance
- Compare variations side-by-side to identify winning treatments
- Use advanced filters to segment and drill down into specific audience or test dataScreenshot of a Program Overview. These offer insights into any experimentation program’s performance. It also offers:

- A comprehensive view of the entire experimentation program’s status and progress
- Monitoring for key performance metrics like test velocity, success rates, and overall impact
- Evaluation of the impact of experiments with easy-to-read visualizations and reporting tools
- Performance tracking of experiments over time to guide decision-making and optimize strategiesScreenshot of AI Variable Suggestions. These enhance experimentation with AI-driven insights, and can also help with:

- Generating multiple content variations with AI to speed up experiment design
- Improving test quality with content suggestions
- Increasing experimentation velocity and achieving better outcomes with AI-powered optimizationScreenshot of Schedule Changes, to streamline experimentation. Users can also:

- Set specific times to toggle flags or rules on/off, ensuring precise control
- Schedule traffic allocation percentages for smooth experiment rollouts
- Increase test velocity and confidence by automating progressive changes