Commit 8537a0e
committed
feat(benchmark): hardware fingerprint, Kaggle notebook, v0.3.0rc1
Make every benchmark result self-describing and add a single-paste
Kaggle entry point so the standardised paper sweeps can run unattended
on a free T4 / P100 session.
swarmtorch/benchmark/hardware.py
hardware_info() collects hostname, OS, CPU model, logical cores,
RAM, Python + PyTorch + CUDA versions, GPU name + memory +
compute capability, and a git short SHA so results are tied to
a code state. Cached, free to call repeatedly.
print_banner() emits the same fields as a loud block at the top
of any script -- so Kaggle / Colab logs open with unambiguous
machine identification.
swarmtorch/benchmark/run.py
run_one() now stamps meta.hardware on every RunResult JSON, so
when results are shared across collaborators the runtime is
fully recoverable from the file.
swarmtorch/benchmark/gpu_vs_numpy.py
Same hardware stamp on every GPUBenchResult. report.md opens
with a Machine: / GPU: / PyTorch: header line.
swarmtorch/benchmark/report.py
The aggregated report pulls hardware info from the first result
(the producing machine), not the machine rebuilding the report,
so summarize_results works correctly across machines.
scripts/cloud_bench.py
--all flag runs the full standardised suite (ablations + HPO +
synthetic + GPU + training). Prints the hardware banner once at
the top of the run. bench-training added to the dispatch table.
scripts/kaggle_run_all.py
Single-paste Kaggle entry point: clone + install + identify +
smoke + full --all suite + zip bundle. Designed for the one-
line "!curl ... | python" Kaggle workflow.
notebooks/kaggle_full_benchmark.ipynb
Cell-by-cell version of the same suite, so the user can read each
report.md inline as it lands instead of waiting for the whole
suite. Default synthetic grid bumped to include d=1000 (the CEC
standard ceiling) so the dimensionality-wall claim survives
review.
pyproject.toml: version 0.2.1 -> 0.3.0rc1
BENCHMARKS.md: Kaggle TL;DR added at top.
tests/test_benchmark_run.py: updated meta assertion to allow the
new auto-injected hardware field.
Test suite: 94 passed, 1 skipped (CUDA-gated), 0 failures.1 parent f2465f7 commit 8537a0e
11 files changed
Lines changed: 837 additions & 10 deletions
File tree
- notebooks
- scripts
- swarmtorch/benchmark
- tests
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
5 | 34 | | |
6 | 35 | | |
7 | | - | |
8 | | - | |
| 36 | + | |
| 37 | + | |
9 | 38 | | |
10 | 39 | | |
11 | 40 | | |
| |||
0 commit comments