Skip to content

olliekm/All-Caps-GPT

Repository files navigation

All Caps GPT | Multi-head attention transformer model for lyric generation.

Following along with Andrej, and adding my own optimizations for specific hyperparameters,All Caps GPT manages to capture patterns and tone within artists lyrics.

About

A multi-head attention transformer model. Trained on various artist's lyrics.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages