Experiment Quality Score

The Concept

The Experiment Quality Score is a metric designed to get a sense for the quality of an experiment configured within Statsig. It helps experimenters quickly identify potential issues in experiment setup, execution, and data collection, ensuring more confident decision-making. Measuring this over a number of experiments can help measure improvements in maturity over time.

Configuring it

You can enable it in Settings -> Experimentation -> Experiment Quality Score. There is a list of pre-defined assessment criteria used. You can customize the weights assigned to each criteria based on relevance to your project.

Viewing it

When enabled, you can view the experiment quality score on any experiment. Applicable checks will be evaluated.