Source
Statistical method & guardrails — found from sitemap — Statsig
Checked for Statsig on 16 Nov 2026
- Page
- https://docs.statsig.com/experiments/statistical-methods/methodologies/benjamini-hochberg-procedure
- Checked
- 16 Nov 2026, 18:22 UTC
- How we may use it
- Public page, crawling permitted
Technical details
- type
- page
- http status
- 200
- content hash
- sha256:1b38073fad7da19bd45465a6c05700fae189e2aac5bbf347fac7b8002526416c
- permission
- robots_ok
- screenshot
- Screenshot on file (internal exhibit, not published)
Cited by
Facts read from this source
-
Bh purpose Report an error
“The Benjamini-Hochberg (BH) procedure adjusts the significance level when a scorecard tests many metrics, so that only a controlled share of the results you call significant are false positives. That share is the false discovery rate.”
-
Bh vs bonferroni Report an error
“Bonferroni correction instead controls the family-wise error rate, the chance of at least one false positive. BH therefore rejects more null hypotheses than Bonferroni for the same p-values.”
-
Bh when to use Report an error
“Use BH when a scorecard has many metrics and a small, controlled share of false positives is acceptable. Use Bonferroni when any single false positive is costly.”
-
Bh enablement Report an error
“Enable the BH procedure for a single experiment under Advanced Settings on its Setup tab, in Multiple Hypothesis Corrections. Organization admins can turn it on by default for every experiment through experiment policies.”
-
Bh scope options Report an error
“Test groups (multiple treatment hypotheses): For each metric, Statsig aggregates the p-values from each variant and runs the BH procedure on that list. Metrics in the scorecard: For each variant, Statsig aggregates the p-values from each metric and runs the BH procedure on that list. Both test groups and metrics: Statsig aggregates all p-values and runs the BH procedure once.”
-
Bh breakdown exclusion Report an error
“Statsig doesn't apply the BH procedure to the p-values of event-dimension or user-property breakdowns of an experiment metric. Statsig compares only the top-line metric results to the new significance level.”
3 facts read from this page are not shown because they could not be confirmed on the page as captured.
Scores citing this record
- The CRO Consultant Statistical method & guardrails
- The CRO Consultant Statistical method & guardrails
- The CRO Consultant Statistical method & guardrails
- The Data Protection Officer Statistical method & guardrails
- The Data Protection Officer Statistical method & guardrails
- The Data Protection Officer Statistical method & guardrails
- The E-Commerce Manager Statistical method & guardrails
- The E-Commerce Manager Statistical method & guardrails
- The E-Commerce Manager Statistical method & guardrails
- The Growth Lead Statistical method & guardrails
- The Growth Lead Statistical method & guardrails
- The Growth Lead Statistical method & guardrails
- The Product Engineer Statistical method & guardrails
- The Product Engineer Statistical method & guardrails
- The Product Engineer Statistical method & guardrails
- The Skeptic Statistical method & guardrails
- The Skeptic Statistical method & guardrails
- The Skeptic Statistical method & guardrails