Skip to content

Allow usage of GPT-4 as judge model  #83

Open
@jaideepr97

Description

@jaideepr97

FastChat has native support for invoking the openAI api (when provided with a valid openAI key) to invoke GPT-4 as the judge for MT-Bench assessments. This capability should be leveraged and made available for users to access, should they wish to.
Users will need to provide their own valid openAI api key

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestmtbenchPertains to MTBenchmtbenchbranchPertains to MTBenchBranch

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions