Evaluated across 1,035 regulated documents.
At DIA 2026, Clinplex presented a multi-framework gap-detection methodology evaluated across SOPs, CAPAs, deviations, audit records, CMC submissions, validation packages and preclinical documents. 96% gap-detection accuracy against blinded SME review.
Gap-detection accuracy
Against SME-panel ground truth.
More gaps surfaced
12.3 gaps per SOP vs 4.1 under single-framework review.
Less assessment time
Cross-framework regulatory assessment.
Critical-tier sensitivity
Agreement with SME review on Critical findings.
Human review was part of the benchmark.
A 1,035-document regulated corpus from biologics, small-molecule and CDMO operating environments. A stratified 312-document subset was independently reviewed by a seven-person Quality and Regulatory panel, blinded to Clinplex output.
Multi-framework analysis found substantially more.
| Performance | Single-framework review | Clinplex multi-framework |
|---|---|---|
| Average gaps per SOP | 4.1 | 12.3 |
| Critical-tier sensitivity | 0.71 | 0.98 |
| Specificity | 0.88 | 0.94 |
| Cross-document linkage | Not evaluated | SOP → CAPA mapped |
Why 3× more findings?
Consistency, and its limits.
Reproducibility
- Outputs evaluated for stability across repeated runs.
- Controls for operating-environment variance.
- Test / retest consistency evaluated over time, not from a single run.
Limitations
The evaluation covered selected organizations, regulatory classes and document types. Results should not be read as universal performance across every organization, document type or framework. Broader cross-organizational and longitudinal evaluation is ongoing.
Reproducibility protocol and evaluation artifacts are available under NDA.
The full evidentiary chain.
Review the underlying work.
AI-Enabled Multi-Framework Regulatory and Quality Gap Detection for Pharmaceutical Operations Across the Product Lifecycle
Claims register: every published figure, its definition, denominator and source CPX-CLAIMS-001 · v1.1
| Wording | Definition | Denominator | Source | Verified | Status |
|---|---|---|---|---|---|
| "96% gap-detection accuracy" | Proportion of AI-identified gaps confirmed as true gaps by the blinded SME panel. Reported with 95% CI. | 312-document subset | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "12.3 gaps per SOP vs 4.1" / "3.0× more gaps surfaced" | Mean gaps per SOP under multi-framework evaluation vs single-framework manual review of the same SOPs. 3.0× is the ratio 12.3 / 4.1. | SOP subset | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "73% less cross-framework assessment time" | Reduction in time to complete cross-framework assessment vs manual single-framework baseline. | Timed subset | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "κ = 0.87 inter-rater agreement" | Cohen's κ for agreement between AI findings and SME-panel adjudication. Reported with 95% CI. | 312-document subset | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "98% critical-tier sensitivity" | Proportion of SME-adjudicated Critical findings detected by Clinplex. | Critical-tier, 312-document subset | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "Evaluated on a 1,035-document corpus" | Total documents in the evaluation corpus. "Evaluated," not "validated": a benchmark evaluation, not a validation under a defined protocol with acceptance criteria. | n = 1,035 | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "Blinded 312-document subset" / "7 SME reviewers" | Stratified subset independently reviewed by a 7-person Quality and Regulatory panel, blinded to AI output; disputes resolved by consensus. | n = 312 of 1,035 | DIA 2026 poster P312 | 2026-06-09 | Verified |
| "273 total gaps" | Unique gaps identified across the full corpus. 12.3 per SOP is the SOP-subset mean; 273 is the corpus-wide count. Different denominators, same study. | Full corpus | DIA 2026 poster P312 | 2026-06-09 | Verified |
| Wording | Definition | Denominator | Source | Verified | Status |
|---|---|---|---|---|---|
| "Findings come back within 48 hours" | Inspection Stress Test turnaround from receipt of the three records to delivery of findings, in business hours. | Per engagement | Operational commitment | 2026-08-31 | Verified |
| "Mutual NDA goes out the same day" | NDA dispatched within one business day of request. | Per request | Operational commitment | 2026-08-31 | Verified |
| "Four lifecycle phases" | Discovery & preclinical, quality/manufacturing, clinical operations, CMC/regulatory submissions, as shown in the product. | Product | Product | 2026-08-31 | Verified |
| "74% of 202 FDA CRLs involved quality or manufacturing deficiencies" | Share of the 202 complete response letters published by FDA citing quality or manufacturing deficiencies. | n = 202 published CRLs | openFDA + trade analysis | 2026-08-31 | Verified |
Only current, verified claims are listed. Owner: security@clinplex.com. Superseded claims are removed from this register and from the site.
Now run it on
your own records.
One closed deviation, its CAPA and the governing SOP. Ranked gaps with citations and a drafted remediation. Free.