Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to use gemini-1.5-flash-8b with caching #4940

Open
Vandivier opened this issue Jan 31, 2025 · 1 comment
Open

Unable to use gemini-1.5-flash-8b with caching #4940

Vandivier opened this issue Jan 31, 2025 · 1 comment
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API.

Comments

@Vandivier
Copy link

"google-cloud-aiplatform>=1.71.1",
"vertexai>=1.71.1",

note: I can't upgrade google-cloud-aiplatform because PIP tells me it depends on vertexai and there is no higher version of vertexai available

similar to
#4009

except:

  1. my issue is particular to 8b
  2. my issue is not particular to stable versions (I've tried gemini-1.5-flash-8b-latest in addition to stable gemini-1.5-flash-8b)
@product-auto-label product-auto-label bot added the api: vertex-ai Issues related to the googleapis/python-aiplatform API. label Jan 31, 2025
@Vandivier
Copy link
Author

by my reading, eg here, "The Vertex AI SDK and the Vertex AI Python client library provide similar functionality with different levels of granularity." so i'm surprised if the model support varies

if there is a general pattern that model support rolls out in one package prior to the other, that would be a good note in the docs for consumers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API.
Projects
None yet
Development

No branches or pull requests

1 participant