Skip to content

v0.4.0

Latest
Latest
Compare
Choose a tag to compare
@dmitry-markin dmitry-markin released this 30 Nov 15:49
v0.4.0
This tag was signed with the committer’s verified signature.
dmitry-markin Dmitry Markin
GPG key ID: 2C577AC80ADEC782
Learn about vigilant mode.
ad4f600
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

[0.4.0] - 2024-11-30

This release adds min_history_tokens context window rolling strategy. It can be handy to keep the last big response in the context. Additionally, the API now provides token usage info.

Added

  • Extend API to report tokens used (#8)
  • Add min_history_tokens rolling context window strategy (#7)

Fixed

  • Fix loading config file passed as CLI option (commit)
  • Remove impossible Error::NoTokenizer and update docs (commit)
Assets 2
Loading