Create and manage holdouts
Create a holdout in the Statsig console, configure its features, population, and percentage, change its salt, and end it.
Create a holdout in the Statsig console to measure the combined impact of a set of features. After you create it, configure which features it covers and how many users it holds out, then manage its percentage and salt until you end it.
Create a holdout
Creating a holdout takes two stages: a dialog that creates the holdout, then its Setup tab, where you configure how it behaves.
- In the Statsig console, go to Holdouts and click Create.
- Enter the name and unit type, and optionally a description, team, and tags. By default, holdouts use
userID. To use a different ID type, select it from the drop-down menu. A holdout applies only to experiments and feature gates that use the same unit type. - Click Create.
Configure a holdout
Open the holdout's Setup tab and use the Settings section:
- Choose a global or selected holdout with the Holdout is global toggle:
- A global holdout captures the aggregate impact of all features developed after the holdout began. Statsig automatically enforces it on new gates, experiments, and layers with the same unit type, and you can opt individual features out.
- A selected holdout captures the aggregate impact of a specific set of features. List them under Include Gates and Include Layers.
- Choose the Population. By default, a holdout applies to a percentage of all users (Population = Everyone). To target a subset of users, apply a targeting gate (Population = Targeting Gate). For example, to create an iOS-only holdout, apply a targeting gate that passes only iOS users.
- Set Holdout % between 1% and 50%. Statsig recommends a small percentage to limit the number of users who don't see new features.
The Setup tab also holds Monitoring Metrics, the metrics Statsig tracks for impact as you roll out changes.
Change the holdout percentage
Changing the Holdout % on a running holdout starts a new Results period from the date of the change. The Results page shows the current period only.
Existing holdout members are kept when you raise the percentage because the salt doesn't change. Units already held out stay held out, and additional units move into the holdout. Unlike feature gates, which merge most rollout increases into one continuous analysis (refer to Multiple rollout stages), holdouts have no equivalent, so there is no continuous view across the change.
Change a holdout's salt
A holdout's salt determines how Statsig hashes units into the holdout group. Set the salt to a value you choose to align salts across holdouts or projects, so the same units land on the same side of each holdout. Aligned salts help when you migrate a holdout or need consistent assignment across projects.
Saving a salt change requires the Launch to Production permission. Changing a salt affects future assignment only: it isn't retroactive, doesn't reload historical data, and doesn't change existing assignments.
To view a holdout's salt, open the holdout's More Actions menu and click View Salts. Any viewer can open the salts dialog. To change the salt, enter the value you want in the dialog and save the change.
Editable salts apply to holdouts only.
End a holdout
To end a holdout and let users in the holdout group see all held-out features, disable the holdout. Disabling the holdout stops tracking the effects of those features, but Statsig retains the results for future reference.
Alternatively, delete the holdout if you created it by mistake or no longer need to keep the results.
Was this helpful?
For AI agents: a documentation index is available at /llms.txt. Append .md to any page URL for markdown, or send Accept: text/markdown.