You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+57-8Lines changed: 57 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -70,15 +70,64 @@ conda run -n Transformers python scripts/make_report.py
70
70
Main report: `reports/benchmark_card_generation_report.md`.
71
71
72
72
<!-- V2_RESEARCH_UPGRADE -->
73
-
## Publishable V2 Research Upgrade
73
+
## Publishable V2 Research Results
74
74
75
-
This repository now includes a project-level V2 experiment suite:
75
+
This repository now includes a full V2 research suite with real data, multiple baselines, ablations, result artifacts, figures, and failure analysis. The README summarizes the measured run so the project can be judged from results, not just project intent.
The V2 artifacts include multiple experiments, ablations, figures, failure cases, and a discussion section while keeping raw caches and large checkpoints out of Git.
79
+
Experiment indexes from the other 8 V2 repositories, converted into benchmark-card records with artifact and limitation checks.
- The generator produced benchmark cards for all 8 upstream repos and scored each card for experiment count, dataset path, artifacts, device metadata, and limitations.
102
+
- Every upstream card currently reaches the schema completeness threshold, giving the portfolio a cross-repo reproducibility index.
103
+
- The generated cards point back to committed reports and result artifacts, so project claims can be audited instead of trusted as prose.
104
+
- This repo now closes the loop: it consumes the portfolio's actual experiment indexes and turns them into standardized research cards.
105
+
106
+
### Failure Analysis
107
+
108
+
The failure-analysis pass found `0` failure records.
109
+
110
+
The public failure artifacts use redacted previews or structured metadata where source examples may contain harmful, private, or otherwise sensitive text. This keeps the analysis reproducible without turning the README into a prompt-injection or unsafe-content corpus.
0 commit comments