Experiment Analysis Settings

Two settings control how long an experiment should run and how strictly Statsig reports its results: the target duration and the significance level. Set them on the experiment's Setup tab. You can change the significance level later from Experiment Results.

Target duration

A target duration is optional, but it helps you wait long enough for the experiment to reach full power. You can set the target as a number of days or a number of exposures. Use the Power Analysis Calculator to determine which target works best for your metrics.

Target durations longer than 90 days: By default, Statsig computes Experiment Results for the first 90 days, though the experiment itself can run longer. Before you set a duration beyond 90 days, consider whether results past that period are still relevant, and whether earlier data might already provide the insights you need.

After you set the target, you can track progress against the target duration or exposure count in the experiment header. Statsig also notifies you through email and Slack (if integrated) when you reach the target.

A target duration doesn't stop the experiment. Standard experiments support a scheduled start but not a scheduled stop, so ending the experiment stays a manual action.

Significance level adjustments

By default, the Experiment Results section displays 95% confidence intervals without Bonferroni correction. You can change these settings during experiment setup or later in Experiment Results.

• Bonferroni Correction: Apply this correction to reduce the risk of false positives in experiments with multiple test groups. Statsig divides the significance level (α) by the number of test groups. For the calculation, go to Bonferroni correction.
• Default Confidence Interval: Choose a lower confidence interval (for example, 80%) if you prefer faster results with a higher tolerance for false positives, or use 95% for greater certainty.