Skip to content

A system for learning how to read and emit Shakespeare using character-level tokens and a transformer model

License

Notifications You must be signed in to change notification settings

sheneman/shakeGPT

Repository files navigation

shakeGPT

A system for learning how to read and emit Shakespeare using character-level tokens and a transformer model.
Useful for learning and teaching about decoder-only transformer models.

image

Install

python -m venv venv
pip install -U pip
pip install -r requirements.txt

Train and Inference

python llm.py

Output

Should produce Shakespearish output kind of like this:

image

Technical Talk on Transformers

Watch this December 2023 YouTube video where I present on Transformers used for next-token prediction:

IMAGE ALT TEXT HERE

About

A system for learning how to read and emit Shakespeare using character-level tokens and a transformer model

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published