Source
Statistical method & guardrails — found from sitemap — Varify.io
Checked for Varify.io on 1 Oct 2026
- Page
- https://varify.io/en/userdocumentation/troubleshooting/tracking-und-auswertung/a-a-test-shows-significance/
- Checked
- 1 Oct 2026, 10:54 UTC
- How we may use it
- Public page, crawling permitted
Technical details
- type
- page
- http status
- 200
- content hash
- sha256:3d115bc91edd18e203016d1618cc06daa166a9189e3f9d3d2422defdc0d536f2
- permission
- robots_ok
- screenshot
- Screenshot on file (internal exhibit, not published)
Cited by
Facts read from this source
-
Statistical approach Report an error
“Varify evaluates test results with a frequentist approach.”
-
Significance threshold Report an error
“When the Coincidence largely ruled out the reciprocal of the p-value as Significance displayed. If this value is above 95 %, Varify shows a significant result .”
-
Aatest purpose Report an error
“An A/A test is used to check the reliability of the test setup. Two identical variants are tested against each other.”
-
Best practice runtime Report an error
“Running time: at least 10 days”
-
Best practice sample size Report an error
“Amount of data: at least 500 conversions per variant”
-
Best practice goals Report an error
“Goals: maximum 3 Metrics, with a focus on the main KPIs”
-
Interim results guidance Report an error
“Ignore intermediate results: Significance values may fluctuate during the term. Only the Final result at the end of the test is meaningful.”
-
Alpha error risk Report an error
“Each additional target increases the probability of a so-called Alpha error. This means that the chance that a difference will be found somewhere by chance increases with the number of metrics.”
-
Experiment API Report an error
“Experiment API”
-
Server side testing Report an error
“Server-side A/B testing”
-
Bigquery integration Report an error
“BigQuery”
-
MFA Report an error
“Multi Factor Authentication (MFA)”
-
Roles permissions Report an error
“Role & Permission Management”
-
Redirect split URL testing Report an error
“Redirect & Split URL Testing”
-
Chrome extension Report an error
“Chrome browser extension”
-
Web analytics Report an error
“Adobe Analytics Integration”
-
Matomo Report an error
“Matomo - Integration via Matomo Tag Manager”
-
Piwik pro Report an error
“Piwik Pro Integration”
-
Posthog Report an error
“PostHog evaluations”
-
Etracker Report an error
“etracker integration”
-
Ga4 tracking Report an error
“Automatic GA4 tracking integration”
-
Shopify tracking Report an error
“Shopify Custom Pixel Integration via Google Tag Manager”
-
Data export Report an error
“Exporting the experiment results from Varify”
-
Disclaimer code responsibility Report an error
“Notice: Varify assumes no responsibility for the functionality of the code and information.”
Scores citing this record
- The CRO Consultant Statistical method & guardrails
- The CRO Consultant Analytics, data export & integrations
- The Data Protection Officer Statistical method & guardrails
- The E-Commerce Manager Statistical method & guardrails
- The Growth Lead Statistical method & guardrails
- The Growth Lead Analytics, data export & integrations
- The Product Engineer Statistical method & guardrails
- The Product Engineer Analytics, data export & integrations
- The Skeptic Statistical method & guardrails