Retrieve All-Variant Pulse Results

gethttps://statsigapi.net/console/v1/experiments/{id}/all_variant_pulse_results

Authorizations

STATSIG-API-KEYstringrequired

apiKey (header)

Path parameters

idstringrequired

Query parameters

controlstringrequired

Control group ID. The synthetic shipped group isn't supported.

Constraints:min length: 1

datestring

Results date in YYYY-MM-DD format. Omit or use total for the full experiment.

confidencestring

Confidence percentage, greater than 0 and less than 100.

bonferroniPrimaryMetricWeightstring

Fraction of alpha allocated to primary metrics, from 0 to 1.

cupedstring

Whether to apply CUPED.

Allowed values:truefalse

applyBonferroniPerVariantstring

Whether to apply Bonferroni correction per variant.

Allowed values:truefalse

applyBonferroniPerMetricstring

Whether to apply Bonferroni correction per metric.

Allowed values:truefalse

applyBenjaminiHochbergPerMetricstring

Whether to apply Benjamini-Hochberg correction per metric.

Allowed values:truefalse

applyBenjaminiHochbergPerVariantstring

Whether to apply Benjamini-Hochberg correction per variant.

Allowed values:truefalse

benjaminiPrimaryMetricsOnlystring

Whether to limit Benjamini-Hochberg correction to primary metrics.

Allowed values:truefalse

Response

application/json

200· Pulse results for every test group against the selected control.

messagestringrequired

A simple string explaining the result of the operation.

dataobjectrequired

Show child attributes

dsstringrequired

Date of the loaded results in YYYY-MM-DD format.

controlGroupIDstringrequired

Group used as the control for every comparison.

comparisonsobject[]required

Results for every non-control group except the synthetic shipped group, in experiment group order. Corrections use the full set of test groups.

primaryMetricsobject[]required

metricIDstringrequired

metricNamestringrequired

directionalitystringrequired

Indicates the desired change direction for the metric. Use "increase" for positive changes and "decrease" for negative changes.

Allowed values:increasedecrease

Example:increase

erroroneOf

Machine-readable reason when pulse statistics are unavailable. Common values include no_data (insufficient data), echidna_unripe (not yet loaded), and setup_incomplete (misconfigured metric source). Additional string values may appear for cohort/bake windows or other load failures.

Example:no_data

Constraints:nullablestring

warningsstring[]

Human-readable warnings about metric data quality, load state, or partial pipeline failures.

absoluteChangenumber

confidenceIntervalDeltanumber

Absolute confidence interval delta

confidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentChangenumber

sequentialTestingConfidenceIntervalDeltanumber

sequentialTestingConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentConfidenceIntervalDeltanumber

percentConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentSequentialTestingConfidenceIntervalDeltanumber

percentSequentialTestingConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

testMeannumber

controlMeannumber

testStdnumber

controlStdnumber

testUnitsnumber

controlUnitsnumber

pValuenumber

sequentialTestingPValuenumber

Constraints:nullable

adjustedAlphanumber

reversePowernumber

percentCredibleIntervalobject

Bayesian credible interval for the percent change. Only returned when results are computed with Bayesian analysis.

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

expectedLossnumber

Bayesian expected loss. Only returned when results are computed with Bayesian analysis.

chanceToBeatnumber

Bayesian probability that the test beats the control. Only returned when results are computed with Bayesian analysis.

sequentialTestingLikelihoodRationumber

SPRT likelihood ratio of the observed data under the alternative vs the null. This is the same value Pulse uses.

sequentialTestingLogLikelihoodRationumber

Natural log of the SPRT likelihood ratio Pulse uses. Compare this to sprtLogLowerLimit and sprtLogUpperLimit.

sprtLowerLimitnumber

Lower SPRT decision boundary on the likelihood-ratio scale. Crossing below this accepts the null.

sprtUpperLimitnumber

Upper SPRT decision boundary on the likelihood-ratio scale. Crossing above this accepts the alternative.

sprtLogLowerLimitnumber

Lower SPRT decision boundary on the log-likelihood-ratio scale. Crossing below this accepts the null.

sprtLogUpperLimitnumber

Upper SPRT decision boundary on the log-likelihood-ratio scale. Crossing above this accepts the alternative.

sprtDecisionstring

SPRT decision from the log likelihood ratio. alternative accepts H1, null accepts H0, and continue means the ratio is still between the boundaries.

Allowed values:alternativenullcontinue

isSprtSignificantboolean

True when the SPRT decision is alternative, meaning the result is statistically significant.

sprtStatsignessstring

Direction of the SPRT decision relative to the metric's desired direction. neutral when the test has not accepted the alternative.

Allowed values:positivenegativeneutral

absoluteToplineImpactnumber

absoluteToplineImpactDeltanumber

relativeToplineImpactnumber

relativeToplineImpactDeltanumber

projectedAbsoluteToplineImpactnumber

projectedAbsoluteToplineImpactDeltanumber

projectedRelativeToplineImpactnumber

projectedRelativeToplineImpactDeltanumber

secondaryMetricsobject[]required

metricIDstringrequired

metricNamestringrequired

directionalitystringrequired

Indicates the desired change direction for the metric. Use "increase" for positive changes and "decrease" for negative changes.

Allowed values:increasedecrease

Example:increase

erroroneOf

Example:no_data

Constraints:nullablestring

warningsstring[]

Human-readable warnings about metric data quality, load state, or partial pipeline failures.

absoluteChangenumber

confidenceIntervalDeltanumber

Absolute confidence interval delta

confidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentChangenumber

sequentialTestingConfidenceIntervalDeltanumber

sequentialTestingConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentConfidenceIntervalDeltanumber

percentConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentSequentialTestingConfidenceIntervalDeltanumber

percentSequentialTestingConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

testMeannumber

controlMeannumber

testStdnumber

controlStdnumber

testUnitsnumber

controlUnitsnumber

pValuenumber

sequentialTestingPValuenumber

Constraints:nullable

adjustedAlphanumber

reversePowernumber

percentCredibleIntervalobject

Bayesian credible interval for the percent change. Only returned when results are computed with Bayesian analysis.

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

expectedLossnumber

Bayesian expected loss. Only returned when results are computed with Bayesian analysis.

chanceToBeatnumber

Bayesian probability that the test beats the control. Only returned when results are computed with Bayesian analysis.

sequentialTestingLikelihoodRationumber

SPRT likelihood ratio of the observed data under the alternative vs the null. This is the same value Pulse uses.

sequentialTestingLogLikelihoodRationumber

Natural log of the SPRT likelihood ratio Pulse uses. Compare this to sprtLogLowerLimit and sprtLogUpperLimit.

sprtLowerLimitnumber

Lower SPRT decision boundary on the likelihood-ratio scale. Crossing below this accepts the null.

sprtUpperLimitnumber

Upper SPRT decision boundary on the likelihood-ratio scale. Crossing above this accepts the alternative.

sprtLogLowerLimitnumber

Lower SPRT decision boundary on the log-likelihood-ratio scale. Crossing below this accepts the null.

sprtLogUpperLimitnumber

Upper SPRT decision boundary on the log-likelihood-ratio scale. Crossing above this accepts the alternative.

sprtDecisionstring

SPRT decision from the log likelihood ratio. alternative accepts H1, null accepts H0, and continue means the ratio is still between the boundaries.

Allowed values:alternativenullcontinue

isSprtSignificantboolean

True when the SPRT decision is alternative, meaning the result is statistically significant.

sprtStatsignessstring

Direction of the SPRT decision relative to the metric's desired direction. neutral when the test has not accepted the alternative.

Allowed values:positivenegativeneutral

absoluteToplineImpactnumber

absoluteToplineImpactDeltanumber

relativeToplineImpactnumber

relativeToplineImpactDeltanumber

projectedAbsoluteToplineImpactnumber

projectedAbsoluteToplineImpactDeltanumber

projectedRelativeToplineImpactnumber

projectedRelativeToplineImpactDeltanumber

otherMetricsobject[]

metricIDstringrequired

metricNamestringrequired

directionalitystringrequired

Indicates the desired change direction for the metric. Use "increase" for positive changes and "decrease" for negative changes.

Allowed values:increasedecrease

Example:increase

erroroneOf

Example:no_data

Constraints:nullablestring

warningsstring[]

Human-readable warnings about metric data quality, load state, or partial pipeline failures.

absoluteChangenumber

confidenceIntervalDeltanumber

Absolute confidence interval delta

confidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentChangenumber

sequentialTestingConfidenceIntervalDeltanumber

sequentialTestingConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentConfidenceIntervalDeltanumber

percentConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

percentSequentialTestingConfidenceIntervalDeltanumber

percentSequentialTestingConfidenceIntervalobject

Confidence interval bounds

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

testMeannumber

controlMeannumber

testStdnumber

controlStdnumber

testUnitsnumber

controlUnitsnumber

pValuenumber

sequentialTestingPValuenumber

Constraints:nullable

adjustedAlphanumber

reversePowernumber

percentCredibleIntervalobject

Bayesian credible interval for the percent change. Only returned when results are computed with Bayesian analysis.

Example:{"lower":-1.33,"upper":1.33}

lowernumberrequired

uppernumberrequired

expectedLossnumber

Bayesian expected loss. Only returned when results are computed with Bayesian analysis.

chanceToBeatnumber

Bayesian probability that the test beats the control. Only returned when results are computed with Bayesian analysis.

sequentialTestingLikelihoodRationumber

SPRT likelihood ratio of the observed data under the alternative vs the null. This is the same value Pulse uses.

sequentialTestingLogLikelihoodRationumber

Natural log of the SPRT likelihood ratio Pulse uses. Compare this to sprtLogLowerLimit and sprtLogUpperLimit.

sprtLowerLimitnumber

Lower SPRT decision boundary on the likelihood-ratio scale. Crossing below this accepts the null.

sprtUpperLimitnumber

Upper SPRT decision boundary on the likelihood-ratio scale. Crossing above this accepts the alternative.

sprtLogLowerLimitnumber

Lower SPRT decision boundary on the log-likelihood-ratio scale. Crossing below this accepts the null.

sprtLogUpperLimitnumber

Upper SPRT decision boundary on the log-likelihood-ratio scale. Crossing above this accepts the alternative.

sprtDecisionstring

SPRT decision from the log likelihood ratio. alternative accepts H1, null accepts H0, and continue means the ratio is still between the boundaries.

Allowed values:alternativenullcontinue

isSprtSignificantboolean

True when the SPRT decision is alternative, meaning the result is statistically significant.

sprtStatsignessstring

Direction of the SPRT decision relative to the metric's desired direction. neutral when the test has not accepted the alternative.

Allowed values:positivenegativeneutral

absoluteToplineImpactnumber

absoluteToplineImpactDeltanumber

relativeToplineImpactnumber

relativeToplineImpactDeltanumber

projectedAbsoluteToplineImpactnumber

projectedAbsoluteToplineImpactDeltanumber

projectedRelativeToplineImpactnumber

projectedRelativeToplineImpactDeltanumber

testGroupIDstringrequired

Group compared with controlGroupID.

400· Invalid request. Please check the request input and try again.

statusintegerrequired

Allowed values:400

messagestringrequired

401· This endpoint only accepts an active CONSOLE key, but an invalid key was sent. Key: console-xxxXXXxxxXXXxxx

statusintegerrequired

Allowed values:401

messagestringrequired

404· Not Found. The requested resource could not be found.

statusintegerrequired

Allowed values:404

messagestringrequired

Retrieve All-Variant Pulse Results

curl -X GET "https://statsigapi.net/console/v1/experiments/{id}/all_variant_pulse_results" \
  -H "Content-Type: application/json" \
  -H "STATSIG-API-KEY: YOUR_API_KEY"

Was this helpful?