Deep dive — methodology
Counterparty-question rehearsal — the 5-decision reproducibility drill
Every $499 Snapshot samples five AI-driven admissions decisions from a target-day and reproduces them defensibly. Not because you need them all today — because the discipline of reproducing five proves the discipline could reproduce any of them tomorrow.
The prompt the rehearsal answers
"Reproduce this AI-generated admissions decision from Day 47 including the applicant's socioeconomic proxy variables, intended major, financial-need estimate, model version at decision-time, admissions-recommendation-score, and lane routed — as a defensible record we can produce for OCR investigation, DOJ Title VI referral, State AG consumer-protection inquiry, accreditor site-visit, or class-action opposition."
The counterparty question — identical shape whether it comes from OCR, plaintiff, accreditor, or carrier
Sample applicant decisions from Day 47
| Applicant ID | Score | Lane | Model version | Decision hash |
|---|
| APP-002534 | 0.0 | Auto-Admit | admissions-recommender-v3.4.1 | adm-002534 |
| APP-002533 | 77.94 | Deny / Waitlist | admissions-recommender-v3.4.1 | adm-002533 |
| APP-002532 | 82.45 | Deny / Waitlist | admissions-recommender-v3.4.1 | adm-002532 |
| APP-002531 | 61.14 | Committee Review | admissions-recommender-v3.4.1 | adm-002531 |
| APP-002525 | 70.65 | Deny / Waitlist | admissions-recommender-v3.4.1 | adm-002525 |
What "defensibly reproduced" means
- Model version pinned. Not "the current model" — the exact model version deployed at decision-time.
- Input snapshot bound. Applicant socioeconomic proxies + intended major + financial-need estimate + GPA + test scores + extracurricular record exactly as they were when the AI scored the applicant.
- Decision hash bound. Cryptographic hash tying the input to the output — makes tampering detectable.
- Retention pipeline independent. The retention system that holds the decision records is not the production model itself — independence of the record from the actor being recorded.
What the rehearsal proves
All 5 sampled Day-47 admissions decisions reproduced with defensible-records match. Model version pinned, decision hash cryptographically bound, input data retained via decision-provenance record. If OCR / DOJ / plaintiff / accreditor / carrier requests any of the ~4,969 applicant decisions in the audit period, the same reproduction procedure applies.
Retention horizon
- FERPA (20 USC 1232g): minimum retention through the student's enrollment lifecycle and access-request window
- State-specific admissions-litigation tail: typically 5-10 years for admissions decisions
- OCR investigation-hold: discipline of preserving through resolution
- Litigation hold: preserves through matter conclusion, may extend original horizon
The rehearsal record is not a one-time exhibit — it is proof that the retention discipline is operational.
Why 5, not 500
Reproducing 500 decisions on request is a discovery-response exercise, appropriately triggered by a specific legal process. Reproducing 5 sample decisions at Snapshot time is a discipline-test: it validates that the retention pipeline works, without exhausting the audit budget on record production nobody has asked for yet.
$499 Snapshot. 3 business days.
Same 5-decision reproducibility drill on your institution's actual admissions-AI surface + counterparty-question rehearsal record.
Buy $499