Skip to main content

Exposures

note

Usually referred to online as feature flags, the Statsig UI and SDKs call them feature gates.

Gate Exposures​

To see the number of users who are being exposed to a feature gate,

  • Log into the Statsig console at https://console.statsig.com
  • On the left-hand navigation panel, select Feature Gates
  • Select the feature gate that you want to test
  • Click on the Pulse Results tab
  • The Cumulative Exposures panel shows total exposures of a feature gate, broken down into three groups-
    1. Units that passed the feature gate, and were used for analysis
    2. Units that did not pass the feature gate, and were used for analysis vs. the "Pass" group
    3. Units that did not pass the feature gate, and were not used for analysis vs. the "Pass" group
Screen Shot 2024-02-19 at 2 36 22 PM

Metric Lifts​

The Metrics Lifts panel shows how your feature is performing based on lifts in any business metrics added to the list of Monitoring Metrics for your gate.

After working with experimentation experts across the industry, we aligned on an equal variant comparison (i.e. 10% vs 10% in this example) for calculating metric lifts for gate rollouts. You can read more about the advantages of this methodology in "A/B Testing Intuition Busters: Common Misunderstandings in Online Controlled Experiments” by Ron Kohavi, Alex Deng, & Lukas Vermeer.

In the example below, the rises in product view count and purchase event count are statistically significant, suggesting this feature positively impacts the number of product views, but may actually be negatively impacting conversions to purchases itself.

Screen Shot 2024-02-19 at 2 50 30 PM

Bots & Filtering​

important

Information on Bots & Filtering has been moved to its own page