Source

Statistical method & guardrails — found from sitemap — Crobox

Checked for Crobox on 13 Oct 2026

Technical details

type: page
http status: 200
content hash: sha256:910121746760dcf58570ec0117f8bd4e7340a899714cca7ed3a771add285538e
permission: robots_ok
screenshot: Screenshot on file (internal exhibit, not published)

Cited by

Data confidence definition Report an error

“Data Confidence measures the trustworthiness of the results from our experiments. This is an important metric that determines the likelihood that the impact of your experiment is accurate and not caused by random chance.”
Data confidence inputs Report an error

“This confidence is based on a combination of the amount of change (impact) and number of trials.”
Data confidence color scale Report an error

“Our data bars go from red (not enough data to be trustworthy) to yellow (slightly trustworthy) to green (trustworthy).”
Ab test calculator Report an error

“To test the data confidence yourselves, try the A/B Test Calculator.”
Statistical method Report an error

“We measure Data Confidence based on statistical significance using a null hypothesis test. This tests the difference between the performance of the Crobox group vs. Control group.”
Control group definition Report an error

“In the Control group, users are exposed to invisible messages so that we can test the difference between the two.”
Significance metrics Report an error

“There are two metrics of importance when determining statistical significance: P Value and Power.”
Min significance Report an error

“A P Value of 0.05 (5%) means you can say with 95% confidence that there is a difference between the Crobox group vs. Control group. We always make sure our experiments have at least 95% statistical significance.”