How to Run a Playground Evaluation

Use the Statsig Warehouse Native playground to evaluate metric and experiment configurations with sample data before committing to production pipelines.

Playground evaluations are only recommended for Enterprise-tier customers.

Many customers evaluating Statsig have sensitive data and long lead times to test on production data due to privacy and data security requirements. Statsig offers a read-only Demo Project, but the demo project doesn't let you fully experience the warehouse native product.

To get full access, contact support to request a Playground Evaluation project. This is a project hosted by Statsig with sample, near-real-time data sources that you can use to set up experiments, analyze metrics, and evaluate Statsig internally. You'll be an admin and can add teammates to explore the shared project together.

Playground projects

Playground projects come with some boilerplate connections hooked up:

A real-time event streaming metric source
A daily user-level metric source
An assignment source with a handful of experiments
A handful of pre-loaded metrics and experiments

Playground projects don't come with any assign-and-analyze experiments, so some features that require SDK usage (e.g. Stratified Sampling) aren't available. You can use a normal demo project with an SDK on a local script to generate data for those use cases.

Evaluation

Follow steps 2 and later from the quick start guide, starting with the tables available to the playground project. This gives you a sense of what running experiments and managing metrics in Statsig involves.After completing those steps, refer to the POC guide and simulate the steps relevant to your evaluation. Exploring the Pulse UI together has been useful for teams. The Statsig team welcomes any questions or feedback.

Was this helpful?