Method
Reproducibility Risk Mapper
Scores whether a study or model result has enough artifacts to be reproduced or independently checked.
Field scoring contract
| Field | Type | Role | Direction | Scored |
|---|---|---|---|---|
| Dataset availability | select | evidence_signal | higher_is_better | yes |
| Code availability | select | evidence_signal | higher_is_better | yes |
| Environment capture | select | evidence_signal | higher_is_better | yes |
| Random seeds and determinism | select | evidence_signal | higher_is_better | yes |
| Dependency versions | select | evidence_signal | higher_is_better | yes |
| Benchmark protocol | select | evidence_signal | higher_is_better | yes |
| Reporting completeness | select | evidence_signal | higher_is_better | yes |
Limits
- Preliminary output
- Human review required
- Not certification
- Domain-specific checks added; not certification
- Context text is not averaged into numeric scores.
- Outputs require source/evidence review before decisions.