Skip to content

Commit

Permalink
Update README.md (#23)
Browse files Browse the repository at this point in the history
  • Loading branch information
samuelgm-openai authored Feb 20, 2025
1 parent 0277efa commit c34709c
Showing 1 changed file with 12 additions and 4 deletions.
16 changes: 12 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,18 @@

This repo contains the dataset and code for the paper ["SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"](https://www.openai.com/index/swe-lancer/).

**Note:** We will continue to update this repository with new tasks and updates to the scaffolding; the code and data here does not exactly match what was used in the paper.
---

Thank you so much for checking out our benchmark! If you have questions, run into issues, or want to contribute, please open an issue or pull request. You can also reach us at [email protected] and [email protected] at any time.

We will continue to update this repository with the latest tasks, updates to the scaffolding, and improvements to the codebase

- If you'd like to use the latest version, please use the `main` branch.

- If you'd like to use the version of the dataset from the paper and codebase at time of paper release, please check out the `paper` branch. Note that the performance outlined in our paper is on our internal scaffold. We've aimed to open-source as much of it as possible, but the open-source agent and harness may not be exactly the same.


---

**Step 1: Package Management and Requirements**

Expand Down Expand Up @@ -160,6 +171,3 @@ For a complete example of a ComputerInterface implementation, you can refer to t
- Provide meaningful error messages
- Handle network issues gracefully

## Contributing

For questions or contributions, please open an issue or pull request.

0 comments on commit c34709c

Please sign in to comment.