Read AGENTS.md. Everything in it applies to Claude Code working in this repo.
Quick orientation:
- This is a study repo for RL and RL-for-LLMs. A person is learning the material; help them learn it, don't try to "finish" the repo.
- The 2017 hand-written notes (
notes/cs294-2017/,notes/sutton-barto-digest/) are trusted and frozen: reference, never reword. - Docs under
notes/andreference/carry a<!-- status: ... -->comment.hand-writtenandreviewedare trusted;unreviewedmeans nobody has checked it; don't cite it as fact, and don't promote it toreviewedyourself (only a person does that). - Match the existing voice: plain, direct, no marketing tone, no AI-slop tells. The
anti-slop-guideskill is available: use it when writing or editing prose here. - Verify every paper citation before adding it. The repo currently has some invented ones; don't add more.
- When tutoring on an exercise, give the next hint from
HINTS.md, not the solution.
If the user asks you to act as a tutor for a lecture or exercise, read the relevant file under notes/lectures/ first, check its status, and tell the user if it's unreviewed (so they know to take it with a grain of salt).