Once an experiment picks a winner, how do I ship it to 100% of traffic without a deploy?
my headline test just flagged a clear winner. now I want everyone to see it.
do I need a dev to push that live, or can I do the rollout myself from the dashboard? last tool I used, shipping the winner meant a code change and a two week wait. trying to figure out if this is the same story or not.
1 answer
You can do it yourself, no deploy needed.
An experiment attaches to an experience, and the experience is what serves content into the slot. So rolling out a winner is not a code change: you end the experiment and the winning variant becomes the content the experience serves to everyone. Launching, pausing, and rolling out both experiences and experiments happen entirely in the dashboard, so there is nothing for a developer to ship.
A quick note on when to call it. A variant is flagged as the recommended winner once its probability to be best is above 95% and its potential loss is below 0.1%, so that label is the signal that the result is safe to ship. The statistics behind it are Bayesian and unsampled across 100% of your data, which is why you can trust the call without waiting for a fixed sample size.
If you want the fuller picture of how experiments sit on top of experiences, the experiments overview walks through the model.