A system for learning how to read and emit Shakespeare using character-level tokens and a transformer model.
Useful for learning and teaching about decoder-only transformer models.
python -m venv venv
pip install -U pip
pip install -r requirements.txt
python llm.py
Should produce Shakespearish output kind of like this:
Watch this December 2023 YouTube video where I present on Transformers used for next-token prediction: