Skip to content

✨ [Cost] Incoming Token Compression #259

New issue
New issue
Open
Open
✨ [Cost] Incoming Token Compression#259
Labels
area:configarea:costCost optimisation & budgetinggep:requiredmodel:embeddingmodel:languagetype:epicA high level issue that usually consist of smaller tasks and corresponds to some functionality
@roma-glushko

Description

@roma-glushko
roma-glushko
opened on May 13, 2024

Support incoming request compression natively in Glide to optimize LLM cost:

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:configarea:costCost optimisation & budgetinggep:requiredmodel:embeddingmodel:languagetype:epicA high level issue that usually consist of smaller tasks and corresponds to some functionality

    Type

    No type

    Projects

    [Glide] Roadmap

    Status

    Icebox

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions