tiktoken@1.0.20
·
19 commits
to main
since this release
Patch Changes
- 5f92348: Add missing historic models, fix incorrect tokenizers for old instruct models