Having Problem registering anthropic Models on Llama-Stack #3701
mansiUnifynd
started this conversation in
General
Replies: 1 comment
-
|
check which models Anthropic's model listing endpoint (https://api.anthropic.com/v1/models) is advertising. you can use anything in the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I’ve been trying to register Anthropic models, but every time I add one it says the model isn’t supported.
Could someone please guide me on how to properly register Anthropic models on Llama Stack? It would be a great help.
Heres the list of things I have done:
I have update the API Key in my run.yaml
- provider_id: anthropic
provider_type: remote::anthropic
config:
api_key: ${env.ANTHROPIC_API_KEY:""}
Below is the command that i am using to register the model:
llama-stack-client models register claude-3-5-sonnet --provider-id anthropic --provider-model-id claude-3-5-sonnet-latest --metadata {} --model-type llm
ERROR I AM GETTING:
INFO:httpx:HTTP Request: POST http://localhost:8321/v1/models "HTTP/1.1 400 Bad Request"
╭─────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Failed to register model │
│ │
│ Error Type: BadRequestError │
│ Details: Error code: 400 - {'detail': 'Invalid value: Unsupported model: claude-3-5-sonnet-latest'} │
Beta Was this translation helpful? Give feedback.
All reactions