AB testing is useless
July 31, 2018

AB testing is useless

Christopher Colahan, MBA | TrustRadius Reviewer
Score 4 out of 10
Vetted Review
Verified User

Overall Satisfaction with Bronto Marketing Platform

Bronto is used by creative to upload HTML coded emails. It is used by the email marketing manager (me) to schedule and segment those emails, as well as report on email metrics.

Pros

  • UI/UX

Cons

  • A/B testing... need to include confidence interval into the equation used to determine a winner. Currently, Bronto declares an email a winner if it has one more of the KPI, even though there's no statistical significance. Other platforms do better.
  • A/B testing... segmentation isn't random enough. I ran multiple AA tests and there was 95% confidence one email performed better than the other... this was based off 120,000 emails measuring sent vs received. This type of test should never result in a winner with statistical significance.
  • Data reporting... data that's able to be exported should be much more customizable. I literally waste hours transcribing certain data by hand.
  • All of our metrics have either gotten worse or stayed flat since moving to Bronto
Bronto was selected before I arrived
Bronto works fine for sending email, but it lacks in A/B testing and reporting. For what it does well, much less expensive options are available.

Bronto Marketing Platform (discontinued) Feature Ratings

Dynamic content
4
Ability to test dynamic content
4
Landing pages
4
A/B testing
1
Mobile optimization
4
Email deliverability reporting
3
List management
3
Triggered drip sequences
5
Dashboards
4
Standard reports
2
Custom reports
2

Comments

  • Carol A. Sistachs | TrustRadius Reviewer
    Hi Christopher, Thank you for taking the time to write a review. I see you are new to Bronto and we want you to have a positive experience with the platform. I've asked your account manager to contact you to work out the issues you are having.

More Reviews of Bronto Marketing Platform (discontinued)