Skip to content

add read_only mode for codex.query #71

Open
@aditya1503

Description

@aditya1503

This PR introduces asynchronous call for codex.query, while we wait for Trustworthy RAG scores, which helps reduce latency by around 35-40% for TLM Validator, we’re explicitly trying to avoid creating Codex entries for good responses, previously a read_only mode was available, this will be very useful to bring it back.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions