This README describes the Epoch AI Docker image registry for SWE-bench.
Our image registry is public, MIT-licensed, and hosted on GitHub Container Registry. Each image can be accessed by its name, and we follow the same naming pattern as the original SWE-bench authors. At the moment, all images only have the tag latest.
The naming format is ghcr.io/epoch-research/swe-bench.eval.<arch>.<instance_id>, for example ghcr.io/epoch-research/swe-bench.eval.x86_64.astropy__astropy-13236.
For x86_64, we're able to build 2290/2294 (99.8%) of the images, and all 500/500 out of the SWE-bench Verified set.
For arm64, 1819 (out of 2294) images are provided on a best-effort basis, and have not been tested.
How to run SWE-bench Verified in one hour on one machine, Epoch AI blog