Data use, training & retention
How this is scored
What happens to prompts, uploaded files, connected data and outputs: whether any of it trains a model (the vendor's or a model provider's), how long it is kept and where logs live, whether zero-retention is available, and whether a data processing agreement covers it.
0 — No statement on training or retention; the privacy policy is a website policy that does not cover the product.
3 — A general statement that business data is "not used for training", with no word on retention, on the model providers behind the product or on logs.
5 — Business data excluded from training by contract, retention periods stated for chats and files, and a DPA offered to business customers.
8 — No-training commitments stated for the vendor and every model provider it routes to, retention configurable by the admin (including deletion of chat history), zero-data-retention terms with the model providers named, and abuse-monitoring retention described.
10 — Data use fully accounted for: training, retention, logging and abuse monitoring stated per model provider, customer-controlled retention and deletion with an audit trail, outputs and connected data treated as customer data in the DPA, and an independent audit (SOC 2, ISO 27001 or ISO 42001) covering the product.
The Skeptic
Training and retention are documented store by store: prompts and answers in Postgres with deletion on request, documents in storage accounts, embedding vectors in Qdrant, and a flat statement that none of it is used for AI model training. The model provider side is pinned down too — Azure OpenAI processes documents in memory only, with an opt-out agreement with Microsoft and abuse monitoring disabled — and a DPA with SCCs is published, backed by ISO 27001, ISO 42001 and SOC 2 Type 2 audits. What keeps it off the top rung: deletion runs through an email to the security team rather than admin-configurable retention with a customer-facing audit trail, and the privacy policy, the retention documentation and the DPA give different figures for retention, which a buyer must reconcile. 3 5 6 7