From a4b9e2c708a8c17fa873d454581ca8148982f7b9 Mon Sep 17 00:00:00 2001 From: knqyf263 Date: Fri, 19 Jul 2024 15:57:47 +0400 Subject: [PATCH] Add Claude 3.5 Sonnet Signed-off-by: knqyf263 --- README.md | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index 828b13e..d795c2f 100644 --- a/README.md +++ b/README.md @@ -77,16 +77,19 @@ Other properties are duplicated from the original input. ## Configuration ### LLM backends -VexLLM is tested with OpenAI GPT-3.5 Turbo. +VexLLM is tested with OpenAI GPT-3.5 Turbo and Anthropic Claude 3.5 Sonnet. The following env vars are recognized: -- `OPENAI_API_KEY` (necessary) -- `OPENAI_MODEL` -- `OPENAI_BASE_URL` -- `OPENAI_API_BASE` -- `OPENAI_ORGANIZATION` - -VexLLM may also work with Google AI, Anthropic, and Ollama, but these backends are not tested. +- OpenAI + - `OPENAI_API_KEY` (necessary) + - `OPENAI_MODEL` + - `OPENAI_BASE_URL` + - `OPENAI_API_BASE` + - `OPENAI_ORGANIZATION` +- Anthropic + - `ANTHROPIC_API_KEY` (necessary) + +VexLLM may also work with Google AI, and Ollama, but these backends are not tested. See [`pkg/llm/...`](./pkg/llm/). ## Command reference