Source
Statistical method & guardrails — found from sitemap — Statsig
Checked for Statsig on 16 Nov 2026
- Page
- https://docs.statsig.com/experiments/statistical-methods/introduction
- Checked
- 16 Nov 2026, 18:22 UTC
- How we may use it
- Public page, crawling permitted
Technical details
- type
- page
- http status
- 200
- content hash
- sha256:902f17630be3467e52fbcb735ffc8846cb4c625efbafb759301b73b45b493bf0
- permission
- robots_ok
- screenshot
- Screenshot on file (internal exhibit, not published)
Cited by
Facts read from this source
-
Stats engine Report an error
“The Statsig Stats Engine is the set of statistical calculations behind the experiment results you read on the Results tab. It turns exposure and metric data into a metric delta, confidence interval, and p-value for each metric, applies variance reduction, and supports frequentist, SPRT, and Bayesian analysis methods.”
-
Metric deltas Report an error
“Metric deltas: The difference in mean metric value between the test and control groups, in absolute and relative terms.”
-
Standard error Report an error
“Standard error and mean variance: How much each group's mean would vary across repeated samples. This is the input to every confidence interval and p-value.”
-
Confidence intervals Report an error
“Confidence intervals: The gray, red, and green bars on the Results tab, which represent the uncertainty in each metric delta.”
-
P values Report an error
“p-values: The probability of observing a metric delta at least as extreme as the one measured, if the treatment has no effect on that metric.”
-
Topline projected impact Report an error
“Topline and projected impact: The daily effect of the experiment on a company metric, and the estimated effect if you launch the test group to all users.”
-
Variance reduction Report an error
“Variance reduction: The techniques Statsig applies so the same effect reaches significance with fewer users.”
-
Cuped Report an error
“CUPED: Uses each user's pre-exposure data to reduce variance. Statsig applies it automatically.”
-
Pre experiment bias Report an error
“Pre-experiment bias: How Statsig detects groups that already differed before exposure and flags the affected metrics.”
-
Frequentist sequential testing Report an error
“Frequentist sequential testing: Adjusts p-values and confidence intervals so you can read results early without inflating false positives.”
-
Sprt Report an error
“Sequential probability ratio tests: Compares the likelihood of your data under the alternative and null hypotheses, and can accept either one.”
-
Bayesian experiments Report an error
“Bayesian experiments: Reports chance to beat control and expected loss, with optional informative priors.”
1 fact read from this page is not shown because it could not be confirmed on the page as captured.
Scores citing this record
- The CRO Consultant Statistical method & guardrails
- The CRO Consultant Statistical method & guardrails
- The Data Protection Officer Statistical method & guardrails
- The Data Protection Officer Statistical method & guardrails
- The E-Commerce Manager Statistical method & guardrails
- The E-Commerce Manager Statistical method & guardrails
- The Growth Lead Statistical method & guardrails
- The Growth Lead Statistical method & guardrails
- The Product Engineer Statistical method & guardrails
- The Product Engineer Statistical method & guardrails
- The Skeptic Statistical method & guardrails
- The Skeptic Statistical method & guardrails