Method
Scientific AI Validation Protocol Generator
What validation protocol is needed for a scientific AI claim?
Field scoring contract
| Field | Type | Role | Direction | Scored |
|---|---|---|---|---|
| Task | text | context | context | no |
| Baseline comparison | select | evidence_signal | higher_is_better | yes |
| Leakage check | select | evidence_signal | higher_is_better | yes |
| Ablations | select | evidence_signal | higher_is_better | yes |
| Uncertainty/calibration | select | evidence_signal | higher_is_better | yes |
| External validity | select | evidence_signal | higher_is_better | yes |
| Reproducibility pack | select | evidence_signal | higher_is_better | yes |
Limits
- Preliminary output
- Human review required
- Not certification
- Context text is not averaged into numeric scores.
- Outputs require source/evidence review before decisions.