-
Notifications
You must be signed in to change notification settings - Fork 36
feat: add google vertex support #13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add google vertex support #13
Conversation
1e8faaf to
28a8749
Compare
4b89e1b to
106ee37
Compare
0574c08 to
08840a9
Compare
08840a9 to
036fa3f
Compare
036fa3f to
f69082a
Compare
| Project: g.options.project, | ||
| Location: g.options.location, | ||
| } | ||
| if g.options.skipAuth { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why is this needed?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
When running tests, specially when gcloud is not installed or configured, we need to skip authorization completely, because otherwise the internal SDKs will try to authenticate with gcloud and fail, and the tests themselves will fail. That means that the tests would always fail on CI, for example.
You made me realize that we might need to do a small adjustment here: we do need authorization to happen when recording, but we still need it to skip when just reproducing the VCRs.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just pushed a commit with a fix.
482cf12 to
1b8c6c6
Compare
This PR adds support for Google Vertex AI.
We're using the Google SDK for Gemini models and the Anthropic SDKs for Claude models. I had to do fixes on both to make it work properly for us.
While those are in review, I pushed the changes on an extra
fantasybranch so we can import from this project.On testing, ensure to use
us-east5region, because not all regions support Anthropic calls. It returns a generic 500 error if you try a not supported region.