For AI agents: a documentation index is available at /llms.txt. Append .md to any page URL for markdown, or send Accept: text/markdown.
Retrieve Pulse Results (Beta)
Retrieve Pulse Results (Beta)
https://statsigapi.net/console/v1/experiments/{id}/pulse_resultsAuthorizations
STATSIG-API-KEYstringrequiredapiKey (header)
Path parameters
idstringrequiredid
Query parameters
controlstringrequiredControl Group ID
teststringrequiredTest Group ID
cupedstringWhether to apply CUPED. Allowed values are "true" or "false".
confidencestringConfidence interval (0-100)
applyBonferroniPerVariantstringWhether to apply Bonferroni Per Variant. Allowed values are "true" or "false".
applyBonferroniPerMetricstringWhether to apply Bonferroni Per Metric. Allowed values are "true" or "false".
bonferroniPrimaryMetricWeightstringα allocated to primary metrics
applyBenjaminiHochbergPerMetricstringWhether to apply Benjamini-Hochberg Correction Per Metric. Allowed values are "true" or "false".
applyBenjaminiHochbergPerVariantstringWhether to apply Benjamini-Hochberg Correction Per Variant. Allowed values are "true" or "false".
benjaminiPrimaryMetricsOnlystringWhether Benjamini-Hochberg correction should apply only to primary metrics. Allowed values are "true" or "false".
datestringDate for pulse results. format must be YYYY-MM-DD
benjaminiAcrossAllTestGroupsstringWhether to compute the Benjamini-Hochberg / Bonferroni-per-group correction across all of the experiment's test groups (matching the Console Results tab default for multi-group experiments) rather than only the requested test-vs-control pair. The returned results are always scoped to the requested pair; this controls only the correction family. Allowed values are "true" or "false". Defaults to "true".
Response
application/jsonmessagestringrequiredA simple string explaining the result of the operation.
dataobjectrequiredShow child attributes
dsstringrequiredprimaryMetricsobject[]requiredmetricIDstringrequiredmetricNamestringrequireddirectionalitystringrequiredIndicates the desired change direction for the metric. Use "increase" for positive changes and "decrease" for negative changes.
increasedecreaseincreaseerroroneOfMachine-readable reason when pulse statistics are unavailable. Common values include no_data (insufficient data), echidna_unripe (not yet loaded), and setup_incomplete (misconfigured metric source). Additional string values may appear for cohort/bake windows or other load failures.
no_datanullablestringstringwarningsstring[]Human-readable warnings about metric data quality, load state, or partial pipeline failures.
absoluteChangenumberconfidenceIntervalDeltanumberAbsolute confidence interval delta
confidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentChangenumbersequentialTestingConfidenceIntervalDeltanumbersequentialTestingConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentConfidenceIntervalDeltanumberpercentConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentSequentialTestingConfidenceIntervalDeltanumberpercentSequentialTestingConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredtestMeannumbercontrolMeannumbertestStdnumbercontrolStdnumbertestUnitsnumbercontrolUnitsnumberpValuenumbersequentialTestingPValuenumbernullableadjustedAlphanumberreversePowernumberpercentCredibleIntervalobjectBayesian credible interval for the percent change. Only returned when results are computed with Bayesian analysis.
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredexpectedLossnumberBayesian expected loss. Only returned when results are computed with Bayesian analysis.
chanceToBeatnumberBayesian probability that the test beats the control. Only returned when results are computed with Bayesian analysis.
sequentialTestingLikelihoodRationumberSPRT likelihood ratio of the observed data under the alternative vs the null. This is the same value Pulse uses.
sequentialTestingLogLikelihoodRationumberNatural log of the SPRT likelihood ratio Pulse uses. Compare this to sprtLogLowerLimit and sprtLogUpperLimit.
sprtLowerLimitnumberLower SPRT decision boundary on the likelihood-ratio scale. Crossing below this accepts the null.
sprtUpperLimitnumberUpper SPRT decision boundary on the likelihood-ratio scale. Crossing above this accepts the alternative.
sprtLogLowerLimitnumberLower SPRT decision boundary on the log-likelihood-ratio scale. Crossing below this accepts the null.
sprtLogUpperLimitnumberUpper SPRT decision boundary on the log-likelihood-ratio scale. Crossing above this accepts the alternative.
sprtDecisionstringSPRT decision from the log likelihood ratio. alternative accepts H1, null accepts H0, and continue means the ratio is still between the boundaries.
alternativenullcontinueisSprtSignificantbooleanTrue when the SPRT decision is alternative, meaning the result is statistically significant.
sprtStatsignessstringDirection of the SPRT decision relative to the metric's desired direction. neutral when the test has not accepted the alternative.
positivenegativeneutralabsoluteToplineImpactnumberabsoluteToplineImpactDeltanumberrelativeToplineImpactnumberrelativeToplineImpactDeltanumberprojectedAbsoluteToplineImpactnumberprojectedAbsoluteToplineImpactDeltanumberprojectedRelativeToplineImpactnumberprojectedRelativeToplineImpactDeltanumbersecondaryMetricsobject[]requiredmetricIDstringrequiredmetricNamestringrequireddirectionalitystringrequiredIndicates the desired change direction for the metric. Use "increase" for positive changes and "decrease" for negative changes.
increasedecreaseincreaseerroroneOfMachine-readable reason when pulse statistics are unavailable. Common values include no_data (insufficient data), echidna_unripe (not yet loaded), and setup_incomplete (misconfigured metric source). Additional string values may appear for cohort/bake windows or other load failures.
no_datanullablestringstringwarningsstring[]Human-readable warnings about metric data quality, load state, or partial pipeline failures.
absoluteChangenumberconfidenceIntervalDeltanumberAbsolute confidence interval delta
confidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentChangenumbersequentialTestingConfidenceIntervalDeltanumbersequentialTestingConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentConfidenceIntervalDeltanumberpercentConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentSequentialTestingConfidenceIntervalDeltanumberpercentSequentialTestingConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredtestMeannumbercontrolMeannumbertestStdnumbercontrolStdnumbertestUnitsnumbercontrolUnitsnumberpValuenumbersequentialTestingPValuenumbernullableadjustedAlphanumberreversePowernumberpercentCredibleIntervalobjectBayesian credible interval for the percent change. Only returned when results are computed with Bayesian analysis.
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredexpectedLossnumberBayesian expected loss. Only returned when results are computed with Bayesian analysis.
chanceToBeatnumberBayesian probability that the test beats the control. Only returned when results are computed with Bayesian analysis.
sequentialTestingLikelihoodRationumberSPRT likelihood ratio of the observed data under the alternative vs the null. This is the same value Pulse uses.
sequentialTestingLogLikelihoodRationumberNatural log of the SPRT likelihood ratio Pulse uses. Compare this to sprtLogLowerLimit and sprtLogUpperLimit.
sprtLowerLimitnumberLower SPRT decision boundary on the likelihood-ratio scale. Crossing below this accepts the null.
sprtUpperLimitnumberUpper SPRT decision boundary on the likelihood-ratio scale. Crossing above this accepts the alternative.
sprtLogLowerLimitnumberLower SPRT decision boundary on the log-likelihood-ratio scale. Crossing below this accepts the null.
sprtLogUpperLimitnumberUpper SPRT decision boundary on the log-likelihood-ratio scale. Crossing above this accepts the alternative.
sprtDecisionstringSPRT decision from the log likelihood ratio. alternative accepts H1, null accepts H0, and continue means the ratio is still between the boundaries.
alternativenullcontinueisSprtSignificantbooleanTrue when the SPRT decision is alternative, meaning the result is statistically significant.
sprtStatsignessstringDirection of the SPRT decision relative to the metric's desired direction. neutral when the test has not accepted the alternative.
positivenegativeneutralabsoluteToplineImpactnumberabsoluteToplineImpactDeltanumberrelativeToplineImpactnumberrelativeToplineImpactDeltanumberprojectedAbsoluteToplineImpactnumberprojectedAbsoluteToplineImpactDeltanumberprojectedRelativeToplineImpactnumberprojectedRelativeToplineImpactDeltanumberotherMetricsobject[]metricIDstringrequiredmetricNamestringrequireddirectionalitystringrequiredIndicates the desired change direction for the metric. Use "increase" for positive changes and "decrease" for negative changes.
increasedecreaseincreaseerroroneOfMachine-readable reason when pulse statistics are unavailable. Common values include no_data (insufficient data), echidna_unripe (not yet loaded), and setup_incomplete (misconfigured metric source). Additional string values may appear for cohort/bake windows or other load failures.
no_datanullablestringstringwarningsstring[]Human-readable warnings about metric data quality, load state, or partial pipeline failures.
absoluteChangenumberconfidenceIntervalDeltanumberAbsolute confidence interval delta
confidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentChangenumbersequentialTestingConfidenceIntervalDeltanumbersequentialTestingConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentConfidenceIntervalDeltanumberpercentConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredpercentSequentialTestingConfidenceIntervalDeltanumberpercentSequentialTestingConfidenceIntervalobjectConfidence interval bounds
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredtestMeannumbercontrolMeannumbertestStdnumbercontrolStdnumbertestUnitsnumbercontrolUnitsnumberpValuenumbersequentialTestingPValuenumbernullableadjustedAlphanumberreversePowernumberpercentCredibleIntervalobjectBayesian credible interval for the percent change. Only returned when results are computed with Bayesian analysis.
{"lower":-1.33,"upper":1.33}lowernumberrequireduppernumberrequiredexpectedLossnumberBayesian expected loss. Only returned when results are computed with Bayesian analysis.
chanceToBeatnumberBayesian probability that the test beats the control. Only returned when results are computed with Bayesian analysis.
sequentialTestingLikelihoodRationumberSPRT likelihood ratio of the observed data under the alternative vs the null. This is the same value Pulse uses.
sequentialTestingLogLikelihoodRationumberNatural log of the SPRT likelihood ratio Pulse uses. Compare this to sprtLogLowerLimit and sprtLogUpperLimit.
sprtLowerLimitnumberLower SPRT decision boundary on the likelihood-ratio scale. Crossing below this accepts the null.
sprtUpperLimitnumberUpper SPRT decision boundary on the likelihood-ratio scale. Crossing above this accepts the alternative.
sprtLogLowerLimitnumberLower SPRT decision boundary on the log-likelihood-ratio scale. Crossing below this accepts the null.
sprtLogUpperLimitnumberUpper SPRT decision boundary on the log-likelihood-ratio scale. Crossing above this accepts the alternative.
sprtDecisionstringSPRT decision from the log likelihood ratio. alternative accepts H1, null accepts H0, and continue means the ratio is still between the boundaries.
alternativenullcontinueisSprtSignificantbooleanTrue when the SPRT decision is alternative, meaning the result is statistically significant.
sprtStatsignessstringDirection of the SPRT decision relative to the metric's desired direction. neutral when the test has not accepted the alternative.
positivenegativeneutralabsoluteToplineImpactnumberabsoluteToplineImpactDeltanumberrelativeToplineImpactnumberrelativeToplineImpactDeltanumberprojectedAbsoluteToplineImpactnumberprojectedAbsoluteToplineImpactDeltanumberprojectedRelativeToplineImpactnumberprojectedRelativeToplineImpactDeltanumberWas this helpful?