Deep dive — methodology

Counterparty-question rehearsal — the 5-decision reproducibility drill

Every $499 Snapshot samples five AI-driven forecast decisions from a target day and reproduces them defensibly. Not because you need them all today — because the discipline of reproducing five proves the discipline could reproduce any of them tomorrow.

The prompt the rehearsal answers

"Reproduce this AI-generated grid-load-forecast + dispatch decision from Day 47 including weather regime, fuel-mix state, DER penetration snapshot, model version, shortage-risk-score, and lane routed — as a defensible record we can produce for NERC compliance audit, FERC Section 206 investigation, state PUC customer-hearing, ISO/RTO market-monitor referral, or wholesale market-manipulation inquiry." The counterparty question — identical shape whether it comes from NERC, FERC, PUC, ISO/RTO market monitor, or plaintiff's counsel

Sample forecast decisions from Day 47

Forecast IDShortage-Risk ScoreDispatch LaneModel versionDecision hash
FCST-00253449.55Demand-Response Readygrid-load-forecaster-v9.1.0gld-002534
FCST-00253349.45Demand-Response Readygrid-load-forecaster-v9.1.0gld-002533
FCST-00253255.80Demand-Response Readygrid-load-forecaster-v9.1.0gld-002532
FCST-00253132.61Baseline Dispatchgrid-load-forecaster-v9.1.0gld-002531
FCST-00252558.20Demand-Response Readygrid-load-forecaster-v9.1.0gld-002525

What "defensibly reproduced" means

  1. Model version pinned. Not "the current model" — the exact model version deployed at forecast-time.
  2. Input snapshot bound. Weather regime + fuel-mix state + DER penetration snapshot + reserve-margin snapshot exactly as they were when the AI scored the interval.
  3. Decision hash bound. Cryptographic hash tying the input to the output — makes tampering detectable.
  4. Retention pipeline independent. The retention system that holds the decision records is not the production model itself — independence of the record from the actor being recorded.

What the rehearsal proves

All 5 sampled Day-47 forecast decisions reproduced with defensible-records match. Model version pinned, decision hash cryptographically bound, input data retained via decision-provenance record. If NERC / FERC / PUC / ISO-RTO market monitor / plaintiff's counsel requests any of the 4,969 forecast intervals in the audit period, the same reproduction procedure applies.

Retention horizon

The rehearsal record is not a one-time exhibit — it is proof that the retention discipline is operational.

Why 5, not 500

Reproducing 500 decisions on request is a discovery-response exercise, appropriately triggered by a specific legal process. Reproducing 5 sample decisions at Snapshot time is a discipline-test: it validates that the retention pipeline works, without exhausting the audit budget on record production nobody has asked for yet.

How does this help me?

Reproducibility discipline is the single largest lever in FERC 206 refund exposure + NERC compliance-audit stance. The dollar frame is direct.

Read: The dollar value of the reproducibility drill →

$499 Snapshot. 3 business days.

Same 5-decision reproducibility drill on your operator's actual AI surface + counterparty-question rehearsal record.

Buy $499