Experiment types & delivery
How this is scored
What can be tested and where: client-side changes through an editor, server-side and feature experiments through SDKs, multivariate and multi-page tests, and personalisation — judged on what the documentation shows rather than on the feature grid.
0 — Not an experimentation tool; the product cannot split traffic or serve variants (analytics, heatmaps or session recording only).
3 — Client-side A/B tests built in a visual editor, with a traffic split and targeting by URL or device.
5 — A/B, split-URL and multivariate tests through a visual or code editor, audience targeting on behaviour and attributes, and either rule-based personalisation or server-side experiments through a documented SDK.
8 — Client-side and server-side experiments through documented SDKs for common languages, multi-page tests, feature-flag experiments sharing one audience and metric model with web tests, mutually exclusive experiment groups, holdouts, and personalisation that can itself be tested against a control.
10 — One experimentation programme across every surface: web, app, server and edge from the same platform, experiment interactions managed, a documented experiment lifecycle from hypothesis to archived result, and a library of past results a team can search.
The CRO Consultant
The documented experiments are A/B comparisons of Apple Ads Custom Product Pages with three traffic-distribution methods (dayparting, parallel, switch), a five-stage lifecycle from setup to scaling, and an experiments hub with portfolio management and monitoring — a genuine testing programme, but on one surface only. We found no public information on a visual editor, server-side SDKs, multivariate tests, holdouts or personalisation, so clients wanting tests beyond Apple Ads pages are not served by this evidence. 3 4