Get more intelligent results to make smarter decisions
SmartStats is our all-new Bayesian powered statistics engine for A/B testing which produces results much faster than before and gives you more control over your testing. You can now plan better, have a more accurate reason to end tests and really understand how close or far apart A and B are.
Isn’t that what you really want from your optimization platform?
You will get results in:
Traditional A/B testing
New SmartStats
Chris Goward
Founder
SmartStats calculates the precise range of your true conversion rate.
MoreUnderstand what you stand to lose if you deployed A when in fact B was actually better.
MoreForget significance, SmartStats gives you the actual probability of A beating B.
MoreGet the probability of a variation beating not just control but other variations as well.
MorePotential loss is the lift you can lose if you deployed A as the winner when in fact B was actually better. SmartStats uses potential loss to end tests. When the potential loss of a variation drops into your comfort threshold, SmartStats suggests that it’s a smart decision to deploy the variation. With a smart decision, you stand to increase your conversion rate and will, most likely, not lose anything since the potential loss from a false positive is minimized.
How smartstats uses potential loss to declare smart decisions
Ph.D, Director of Data Science - VWO
Depending on how much of a direct impact a test can have on your revenue, you can pick one of the three modes to help you find answers as quickly as possible. SmartStats will end the test when the potential loss falls into your comfort zone.
As SmartStats becomes surer about the conversion rates of A and B, it better estimates the potential loss of chosing A. By choosing a mode you define a threshold and once the potential loss falls under this threshold, SmartStats ends the test and declares a smart decision.
Great for finding quick trends.
With this mode you can reduce your testing time for non-critical tests where there isn’t a risk of hurting your revenue directly by deploying a false winner.
Ideal for most tests
This is the default mode and can be used for almost all tests. As the name suggests it is the best balance between testing time and minimizing potential loss.
Best for revenue-critical tests when you want to absolutely minimize potential loss.
Suppose you have an e-Commerce website and you want to test changes to your checkout flow. You want to be as certain as possible to minimize potential loss from deploying a false winner even if it takes a lot of time. This is the best mode for such critical tests which affect your revenue directly.
You no longer have to worry about getting inaccurate results because of regularly monitoring your tests.
As you setup the test, SmartStats automatically estimates the number of users you need to test based on different factors.
SmartStats is smart enough to detect methodology mistakes and guides you to get the most accurate results.
Get everything you need to know about SmartStats and Bayesian A/B testing on email.
Craig Sullivan
Optimization consultant and founder
Daniel Gniazdo
Online marketing specialist
Nathan Shurilla
Associate Director, Value Drive Inc
Upgrade your trial account directly to a paid account after your trial expires. No campaign data will be lost during the upgrade.
VWO does [A/B Testing] so disruptively, embarrassingly better than Google does that it puts a smile on my face.