Become an AI Specialist · module 2 of 8
The gate
The instrument for measuring that something works: when the rule is written, the three ways to measure, the rubric, volume, a held-back test set, outcome and path, the judge's independence, the broken gate.
What this module changes: Fits a gate to the ring. A barrier that drops onto the rail: nothing passes until the measurement comes back clean, and what does not pass falls to the tray.
- Write the pass rule before the runDid it work? What am I actually comparing it against?
Written, not built yet.
- Pick the right one of the three ways to measureHow many ways are there to check an answer, and which one fits?
Written, not built yet.
- Tell the judge exactly how to scoreThe judge gives it a score — based on what?
Written, not built yet.
- Measure on twenty cases, not oneIt worked once. Will it keep working?
Written, not built yet.
- Prove it works on cases it never sawIt passes my examples — will it pass the next one?
Written, not built yet.
- Score the outcome and the path separatelyThe answer is right — does it matter how it got there?
Written, not built yet.
- Stop the producer grading its own workIs the thing scoring the work the same thing that did it?
Written, not built yet.
- Distrust a check that never fails anythingEverything passes the check. Is that good news?
Written, not built yet.