chore(community): bump supported Python version to include 3.14 #1416
Google Cloud Build / langchain-google-vertexai-us (llm-integration-tests)
succeeded
Dec 8, 2025 in 26m 55s
Summary
Build Information
| Trigger | langchain-google-vertexai-us |
| Build | c1364b8f-d5c6-4190-9d8a-03bcfc06e014 |
| Start | 2025-12-07T21:31:45-08:00 |
| Duration | 26m8.491s |
| Status | SUCCESS |
Steps
| Step | Status | Duration |
|---|---|---|
| integration tests | SUCCESS | 26m4.232s |
Details
starting build "c1364b8f-d5c6-4190-9d8a-03bcfc06e014"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch 720fb56d44846161d71a72bfa6814927d4d6be20 -> FETCH_HEAD
HEAD is now at 720fb56 chore(community): update community pyproject.toml requires-python to <4.0.0, to match geni and vertex modules
GitCommit:
720fb56d44846161d71a72bfa6814927d4d6be20
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
53c88f1dfeb7: Already exists
eae668646f44: Already exists
ff2e6e687b6c: Already exists
7c40a3faff76: Already exists
70bbc8515263: Pulling fs layer
20a3f69f2611: Pulling fs layer
7d045536fc2b: Pulling fs layer
7d045536fc2b: Verifying Checksum
7d045536fc2b: Download complete
70bbc8515263: Verifying Checksum
70bbc8515263: Download complete
20a3f69f2611: Verifying Checksum
20a3f69f2611: Download complete
70bbc8515263: Pull complete
20a3f69f2611: Pull complete
7d045536fc2b: Pull complete
Digest: sha256:bf2d36b8fb1b4a0b590b36736cdd8a6b5175b411bf135c42694ecd68ab8fed02
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 92.2 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 25.3
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.14 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 128 packages in 1ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-cloud-aiplatform (7.7MiB)
Downloading hf-xet (3.2MiB)
Downloading tokenizers (3.1MiB)
Downloading pygments (1.2MiB)
Downloading pydantic-core (2.0MiB)
Downloading numpy (16.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading zstandard (5.3MiB)
Downloading pyarrow (45.5MiB)
Downloading shapely (3.0MiB)
Downloading grpcio (6.3MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading shapely
Downloading zstandard
Downloading pygments
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading grpcio
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.37s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 364ms
+ annotated-types==0.7.0
+ anthropic==0.72.1
+ anyio==4.11.0
+ bottleneck==1.6.0
+ cachetools==6.2.1
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.0
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.0
+ freezegun==1.5.5
+ fsspec==2025.10.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.43.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.127.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.5.0
+ google-crc32c==1.7.1
+ google-genai==1.49.0
+ google-resumable-media==2.7.2
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.1.2
+ idna==3.11
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.0.5
+ langchain-core==1.1.0
+ langchain-google-vertexai==3.1.1 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.0.1
+ langchain-tests==1.0.1
+ langgraph==1.0.3
+ langgraph-checkpoint==3.0.1
+ langgraph-prebuilt==1.0.2
+ langgraph-sdk==0.2.9
+ langsmith==0.4.42
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ multidict==6.7.0
+ numexpr==2.14.1
+ numpy==2.3.4
+ orjson==3.11.4
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ propcache==0.4.1
+ proto-plus==1.26.1
+ protobuf==6.33.0
+ py-cpuinfo==9.0.0
+ pyarrow==22.0.0
+ pyasn1==0.6.1
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.4
+ pydantic-core==2.41.5
+ pygments==2.19.2
+ pyparsing==3.2.5
+ pytest==8.4.2
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.32.5
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shapely==2.1.2
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==4.9.1
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.5.0
+ validators==0.35.0
+ vcrpy==7.0.0
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ yarl==1.22.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.14, pytest-8.4.2, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, anyio-4.11.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, syrupy-4.9.1, xdist-3.8.0, retry-1.7.0, langsmith-0.4.42
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 271 items
tests/integration_tests/test_anthropic_cache.py ssss [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..x............R..X...... [ 15%]
........R.R.................Xx....XX.......... [ 32%]
tests/integration_tests/test_compile.py . [ 32%]
tests/integration_tests/test_embeddings.py ......... [ 35%]
tests/integration_tests/test_evaluation.py ...x [ 37%]
tests/integration_tests/test_image_utils.py s [ 37%]
tests/integration_tests/test_llms.py ...x...... [ 41%]
tests/integration_tests/test_llms_safety.py .. [ 42%]
tests/integration_tests/test_maas.py ............................s [ 52%]
tests/integration_tests/test_model_garden.py ................ [ 58%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 70%]
sssssssssssss...................................sss...s.x [ 91%]
tests/integration_tests/test_vectorstores.py .................ss. [ 98%]
tests/integration_tests/test_vision_models.py sss. [100%]
=============================== warnings summary ===============================
tests/integration_tests/test_anthropic_files.py::test_pdf_gcs_uri
tests/integration_tests/test_chat_models.py::test_multimodal
tests/integration_tests/test_chat_models.py::test_multimodal
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching_tools
tests/integration_tests/test_chat_models.py::test_context_catching_tools
tests/integration_tests/test_chat_models.py::test_multimodal_pdf_input_gcs
/workspace/libs/vertexai/langchain_google_vertexai/_image_utils.py:204: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(gcs_uri, gcs_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[video]
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[audio]
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[image]
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:310: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64_template
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:354: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64_agent
<frozen abc>:106: LangGraphDeprecatedSinceV10: AgentStatePydantic has been moved to `langchain.agents`. Please update your import to `from langchain.agents import AgentStatePydantic`. Deprecated in LangGraph V1.0 to be removed in V2.0.
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64_agent
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:383: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_audio_timestamp
tests/integration_tests/test_chat_models.py::test_audio_timestamp
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:412: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_parse_history_gemini_multimodal_FC
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:439: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching_tools
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/caching/_caching.py:161: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_evaluation.py::test_evaluate_pairwise
/workspace/libs/vertexai/langchain_google_vertexai/evaluators/_core.py:62: UserWarning: Ignoring input in VertexPairWiseStringEvaluator, as it is not expected.
warn(self._skip_input_warning)
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/_model_garden/_model_garden_models.py:278: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/vision_models/_vision_models.py:1437: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/vision_models/_vision_models.py:154: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=================================== XPASSES ====================================
======================= the following tests were retried =======================
test_audio_timestamp failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: assert None
+ where None = <function search at 0x7fd17df153a0>('(\\d{2}:\\d{2}:?|\\[\\d{2}:\\d{2}:\\d{2}\\])', "Google's offices and data centers around the world run on electricity, and we're determined to power them with carbon..., we are helping bring Google and the world one step closer to running on carbon-free energy, every hour of every day.")
+ where <function search at 0x7fd17df153a0> = re.search
+ and "Google's offices and data centers around the world run on electricity, and we're determined to power them with carbon..., we are helping bring Google and the world one step closer to running on carbon-free energy, every hour of every day." = AIMessage(content="Google's offices and data centers around the world run on electricity, and we're determined to powe..._metadata={'input_tokens': 2509, 'output_tokens': 333, 'total_tokens': 2842, 'input_token_details': {'cache_read': 0}}).content
test_audio_timestamp passed on attempt 2!
test_chat_vertexai_gemini_image_output failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: Did not find the expected text content
assert None is not None
test_chat_vertexai_gemini_image_output passed on attempt 2!
test_chat_vertexai_gemini_image_output_with_generation_config failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: Did not find the expected text content
assert None is not None
test_chat_vertexai_gemini_image_output_with_generation_config passed on attempt 2!
=========================== end of test retry report ===========================
============================= slowest 5 durations ==============================
344.48s call tests/integration_tests/test_model_garden.py::test_model_garden[FALCON_ENDPOINT_ID-generated_text]
89.73s call tests/integration_tests/test_model_garden.py::test_model_garden_agenerate[FALCON_ENDPOINT_ID-generated_text]
64.73s call tests/integration_tests/test_chat_models.py::test_context_catching_tools
59.04s call tests/integration_tests/test_chat_models.py::test_context_catching
53.38s call tests/integration_tests/test_model_garden.py::test_model_garden_generate[FALCON_ENDPOINT_ID-generated_text]
=========================== short test summary info ============================
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:12: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:36: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:72: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:116: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:54: too long & expensive
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:69: too long & expensive
SKIPPED [1] tests/integration_tests/test_image_utils.py:8: CI testing not set up
SKIPPED [1] tests/integration_tests/test_maas.py:82: got empty parameter set for (model_name)
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/base.py: need --first option to run
SKIPPED [26] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:785: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:823: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1365: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1975: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2058: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2140: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3042: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3112: need --first option to run
SKIPPED [1] tests/integration_tests/test_standard.py:63: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2697: Model does not support image tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2796: Model does not support PDF tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2910: Model does not explicitly support Anthropic inputs.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3141: VCR not set up.
SKIPPED [1] tests/integration_tests/test_vectorstores.py:329: rebuild the index with restricts
SKIPPED [1] tests/integration_tests/test_vectorstores.py:353: need --long option to run
SKIPPED [1] tests/integration_tests/test_vision_models.py:14: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:53: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:68: Visual question answering is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
XFAIL tests/integration_tests/test_chat_models.py::test_init_from_credentials_obj - can't create service account key on gcp
XFAIL tests/integration_tests/test_chat_models.py::test_candidates - vertex api doesn't respect n/candidate_count
XFAIL tests/integration_tests/test_chat_models.py::test_label_metadata_invoke_method - can't add labels to the gemini content using invoke method
XFAIL tests/integration_tests/test_evaluation.py::test_evaluate_pairwise - TODO: investigate (started failing 2025-03-25).
XFAIL tests/integration_tests/test_llms.py::test_vertex_generate_multiple_candidates - VertexAI doesn't always respect number of candidates
XFAIL tests/integration_tests/test_standard.py::TestGemini_15_AIStandard::test_audio_inputs - [NOTRUN] Multimodal tests require integration secrets (user agent to fetch external resources)
XPASS tests/integration_tests/test_chat_models.py::test_multimodal_video_metadata[video] - investigating
XPASS tests/integration_tests/test_chat_models.py::test_label_metadata - can't add labels to the gemini content
XPASS tests/integration_tests/test_chat_models.py::test_logprobs - logprobs are subject to daily quotas
XPASS tests/integration_tests/test_chat_models.py::test_logprobs_with_json_schema - logprobs are subject to daily quotas
= 200 passed, 61 skipped, 6 xfailed, 4 xpassed, 23 warnings, 3 retried in 1546.56s (0:25:46) =
starting build "c1364b8f-d5c6-4190-9d8a-03bcfc06e014"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch 720fb56d44846161d71a72bfa6814927d4d6be20 -> FETCH_HEAD
HEAD is now at 720fb56 chore(community): update community pyproject.toml requires-python to <4.0.0, to match geni and vertex modules
GitCommit:
720fb56d44846161d71a72bfa6814927d4d6be20
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
53c88f1dfeb7: Already exists
eae668646f44: Already exists
ff2e6e687b6c: Already exists
7c40a3faff76: Already exists
70bbc8515263: Pulling fs layer
20a3f69f2611: Pulling fs layer
7d045536fc2b: Pulling fs layer
7d045536fc2b: Verifying Checksum
7d045536fc2b: Download complete
70bbc8515263: Verifying Checksum
70bbc8515263: Download complete
20a3f69f2611: Verifying Checksum
20a3f69f2611: Download complete
70bbc8515263: Pull complete
20a3f69f2611: Pull complete
7d045536fc2b: Pull complete
Digest: sha256:bf2d36b8fb1b4a0b590b36736cdd8a6b5175b411bf135c42694ecd68ab8fed02
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 92.2 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 25.3
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.14 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 128 packages in 1ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-cloud-aiplatform (7.7MiB)
Downloading hf-xet (3.2MiB)
Downloading tokenizers (3.1MiB)
Downloading pygments (1.2MiB)
Downloading pydantic-core (2.0MiB)
Downloading numpy (16.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading zstandard (5.3MiB)
Downloading pyarrow (45.5MiB)
Downloading shapely (3.0MiB)
Downloading grpcio (6.3MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading shapely
Downloading zstandard
Downloading pygments
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading grpcio
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.37s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 364ms
+ annotated-types==0.7.0
+ anthropic==0.72.1
+ anyio==4.11.0
+ bottleneck==1.6.0
+ cachetools==6.2.1
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.0
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.0
+ freezegun==1.5.5
+ fsspec==2025.10.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.43.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.127.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.5.0
+ google-crc32c==1.7.1
+ google-genai==1.49.0
+ google-resumable-media==2.7.2
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.1.2
+ idna==3.11
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.0.5
+ langchain-core==1.1.0
+ langchain-google-vertexai==3.1.1 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.0.1
+ langchain-tests==1.0.1
+ langgraph==1.0.3
+ langgraph-checkpoint==3.0.1
+ langgraph-prebuilt==1.0.2
+ langgraph-sdk==0.2.9
+ langsmith==0.4.42
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ multidict==6.7.0
+ numexpr==2.14.1
+ numpy==2.3.4
+ orjson==3.11.4
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ propcache==0.4.1
+ proto-plus==1.26.1
+ protobuf==6.33.0
+ py-cpuinfo==9.0.0
+ pyarrow==22.0.0
+ pyasn1==0.6.1
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.4
+ pydantic-core==2.41.5
+ pygments==2.19.2
+ pyparsing==3.2.5
+ pytest==8.4.2
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.32.5
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shapely==2.1.2
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==4.9.1
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.5.0
+ validators==0.35.0
+ vcrpy==7.0.0
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ yarl==1.22.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.14, pytest-8.4.2, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, anyio-4.11.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, syrupy-4.9.1, xdist-3.8.0, retry-1.7.0, langsmith-0.4.42
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 271 items
tests/integration_tests/test_anthropic_cache.py ssss [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..x............R..X...... [ 15%]
........R.R.................Xx....XX.......... [ 32%]
tests/integration_tests/test_compile.py . [ 32%]
tests/integration_tests/test_embeddings.py ......... [ 35%]
tests/integration_tests/test_evaluation.py ...x [ 37%]
tests/integration_tests/test_image_utils.py s [ 37%]
tests/integration_tests/test_llms.py ...x...... [ 41%]
tests/integration_tests/test_llms_safety.py .. [ 42%]
tests/integration_tests/test_maas.py ............................s [ 52%]
tests/integration_tests/test_model_garden.py ................ [ 58%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 70%]
sssssssssssss...................................sss...s.x [ 91%]
tests/integration_tests/test_vectorstores.py .................ss. [ 98%]
tests/integration_tests/test_vision_models.py sss. [100%]
=============================== warnings summary ===============================
tests/integration_tests/test_anthropic_files.py::test_pdf_gcs_uri
tests/integration_tests/test_chat_models.py::test_multimodal
tests/integration_tests/test_chat_models.py::test_multimodal
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching_tools
tests/integration_tests/test_chat_models.py::test_context_catching_tools
tests/integration_tests/test_chat_models.py::test_multimodal_pdf_input_gcs
/workspace/libs/vertexai/langchain_google_vertexai/_image_utils.py:204: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(gcs_uri, gcs_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[video]
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[audio]
tests/integration_tests/test_chat_models.py::test_
...
[Logs truncated due to log size limitations. For full logs, see https://console.cloud.google.com/logs/viewer?advancedFilter=resource.type%3D%22build%22+AND+resource.labels.build_id%3D%22c1364b8f-d5c6-4190-9d8a-03bcfc06e014%22+AND+resource.labels.build_trigger_id%3D%22e5368ed3-68b5-4039-85d4-5851c31a160a%22&project=llm-integration-tests.]
...
e_pairwise
/workspace/libs/vertexai/langchain_google_vertexai/evaluators/_core.py:62: UserWarning: Ignoring input in VertexPairWiseStringEvaluator, as it is not expected.
warn(self._skip_input_warning)
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/_model_garden/_model_garden_models.py:278: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/vision_models/_vision_models.py:1437: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/vision_models/_vision_models.py:154: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=================================== XPASSES ====================================
======================= the following tests were retried =======================
test_audio_timestamp failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: assert None
+ where None = <function search at 0x7fd17df153a0>('(\\d{2}:\\d{2}:?|\\[\\d{2}:\\d{2}:\\d{2}\\])', "Google's offices and data centers around the world run on electricity, and we're determined to power them with carbon..., we are helping bring Google and the world one step closer to running on carbon-free energy, every hour of every day.")
+ where <function search at 0x7fd17df153a0> = re.search
+ and "Google's offices and data centers around the world run on electricity, and we're determined to power them with carbon..., we are helping bring Google and the world one step closer to running on carbon-free energy, every hour of every day." = AIMessage(content="Google's offices and data centers around the world run on electricity, and we're determined to powe..._metadata={'input_tokens': 2509, 'output_tokens': 333, 'total_tokens': 2842, 'input_token_details': {'cache_read': 0}}).content
test_audio_timestamp passed on attempt 2!
test_chat_vertexai_gemini_image_output failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: Did not find the expected text content
assert None is not None
test_chat_vertexai_gemini_image_output passed on attempt 2!
test_chat_vertexai_gemini_image_output_with_generation_config failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: Did not find the expected text content
assert None is not None
test_chat_vertexai_gemini_image_output_with_generation_config passed on attempt 2!
=========================== end of test retry report ===========================
============================= slowest 5 durations ==============================
344.48s call tests/integration_tests/test_model_garden.py::test_model_garden[FALCON_ENDPOINT_ID-generated_text]
89.73s call tests/integration_tests/test_model_garden.py::test_model_garden_agenerate[FALCON_ENDPOINT_ID-generated_text]
64.73s call tests/integration_tests/test_chat_models.py::test_context_catching_tools
59.04s call tests/integration_tests/test_chat_models.py::test_context_catching
53.38s call tests/integration_tests/test_model_garden.py::test_model_garden_generate[FALCON_ENDPOINT_ID-generated_text]
=========================== short test summary info ============================
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:12: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:36: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:72: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:116: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:54: too long & expensive
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:69: too long & expensive
SKIPPED [1] tests/integration_tests/test_image_utils.py:8: CI testing not set up
SKIPPED [1] tests/integration_tests/test_maas.py:82: got empty parameter set for (model_name)
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/base.py: need --first option to run
SKIPPED [26] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:785: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:823: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1365: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1975: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2058: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2140: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3042: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3112: need --first option to run
SKIPPED [1] tests/integration_tests/test_standard.py:63: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2697: Model does not support image tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2796: Model does not support PDF tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2910: Model does not explicitly support Anthropic inputs.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3141: VCR not set up.
SKIPPED [1] tests/integration_tests/test_vectorstores.py:329: rebuild the index with restricts
SKIPPED [1] tests/integration_tests/test_vectorstores.py:353: need --long option to run
SKIPPED [1] tests/integration_tests/test_vision_models.py:14: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:53: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:68: Visual question answering is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
XFAIL tests/integration_tests/test_chat_models.py::test_init_from_credentials_obj - can't create service account key on gcp
XFAIL tests/integration_tests/test_chat_models.py::test_candidates - vertex api doesn't respect n/candidate_count
XFAIL tests/integration_tests/test_chat_models.py::test_label_metadata_invoke_method - can't add labels to the gemini content using invoke method
XFAIL tests/integration_tests/test_evaluation.py::test_evaluate_pairwise - TODO: investigate (started failing 2025-03-25).
XFAIL tests/integration_tests/test_llms.py::test_vertex_generate_multiple_candidates - VertexAI doesn't always respect number of candidates
XFAIL tests/integration_tests/test_standard.py::TestGemini_15_AIStandard::test_audio_inputs - [NOTRUN] Multimodal tests require integration secrets (user agent to fetch external resources)
XPASS tests/integration_tests/test_chat_models.py::test_multimodal_video_metadata[video] - investigating
XPASS tests/integration_tests/test_chat_models.py::test_label_metadata - can't add labels to the gemini content
XPASS tests/integration_tests/test_chat_models.py::test_logprobs - logprobs are subject to daily quotas
XPASS tests/integration_tests/test_chat_models.py::test_logprobs_with_json_schema - logprobs are subject to daily quotas
= 200 passed, 61 skipped, 6 xfailed, 4 xpassed, 23 warnings, 3 retried in 1546.56s (0:25:46) =
starting build "c1364b8f-d5c6-4190-9d8a-03bcfc06e014"
FETCHSOURCE
From https://github.com/langchain-ai/langchain-google
* branch 720fb56d44846161d71a72bfa6814927d4d6be20 -> FETCH_HEAD
HEAD is now at 720fb56 chore(community): update community pyproject.toml requires-python to <4.0.0, to match geni and vertex modules
GitCommit:
720fb56d44846161d71a72bfa6814927d4d6be20
BUILD
Pulling image: python:3.11
3.11: Pulling from library/python
53c88f1dfeb7: Already exists
eae668646f44: Already exists
ff2e6e687b6c: Already exists
7c40a3faff76: Already exists
70bbc8515263: Pulling fs layer
20a3f69f2611: Pulling fs layer
7d045536fc2b: Pulling fs layer
7d045536fc2b: Verifying Checksum
7d045536fc2b: Download complete
70bbc8515263: Verifying Checksum
70bbc8515263: Download complete
20a3f69f2611: Verifying Checksum
20a3f69f2611: Download complete
70bbc8515263: Pull complete
20a3f69f2611: Pull complete
7d045536fc2b: Pull complete
Digest: sha256:bf2d36b8fb1b4a0b590b36736cdd8a6b5175b411bf135c42694ecd68ab8fed02
Status: Downloaded newer image for python:3.11
docker.io/library/python:3.11
Using pip 24.0 from /usr/local/lib/python3.11/site-packages/pip (python 3.11)
Collecting uv==0.8.13
Obtaining dependency information for uv==0.8.13 from https://files.pythonhosted.org/packages/82/6b/81387a715dd045f7edea452fb76a5896dcfc11b8ecf0db5106f4b0f633ec/uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.8.13-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 92.2 MB/s eta 0:00:00
Installing collected packages: uv
Successfully installed uv-0.8.13
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip is available: 24.0 -> 25.3
[notice] To update, run: pip install --upgrade pip
Using CPython 3.11.14 interpreter at: /usr/local/bin/python3
Creating virtual environment at: .venv
Resolved 128 packages in 1ms
Building langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading google-cloud-aiplatform (7.7MiB)
Downloading hf-xet (3.2MiB)
Downloading tokenizers (3.1MiB)
Downloading pygments (1.2MiB)
Downloading pydantic-core (2.0MiB)
Downloading numpy (16.2MiB)
Downloading google-api-python-client (14.0MiB)
Downloading zstandard (5.3MiB)
Downloading pyarrow (45.5MiB)
Downloading shapely (3.0MiB)
Downloading grpcio (6.3MiB)
Downloading pydantic-core
Downloading tokenizers
Downloading hf-xet
Downloading shapely
Downloading zstandard
Downloading pygments
Built langchain-google-vertexai @ file:///workspace/libs/vertexai
Downloading grpcio
Downloading google-api-python-client
Downloading numpy
Downloading pyarrow
Downloading google-cloud-aiplatform
Prepared 115 packages in 2.37s
warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
If the cache and target directories are on different filesystems, hardlinking may not be supported.
If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
Installed 115 packages in 364ms
+ annotated-types==0.7.0
+ anthropic==0.72.1
+ anyio==4.11.0
+ bottleneck==1.6.0
+ cachetools==6.2.1
+ certifi==2025.11.12
+ cffi==2.0.0
+ charset-normalizer==3.4.4
+ click==8.3.0
+ distro==1.9.0
+ docstring-parser==0.17.0
+ execnet==2.1.2
+ filelock==3.20.0
+ freezegun==1.5.5
+ fsspec==2025.10.0
+ google-api-core==2.28.1
+ google-api-python-client==2.187.0
+ google-auth==2.43.0
+ google-auth-httplib2==0.2.1
+ google-cloud-aiplatform==1.127.0
+ google-cloud-bigquery==3.38.0
+ google-cloud-core==2.5.0
+ google-cloud-datastore==2.21.0
+ google-cloud-resource-manager==1.15.0
+ google-cloud-storage==3.5.0
+ google-crc32c==1.7.1
+ google-genai==1.49.0
+ google-resumable-media==2.7.2
+ googleapis-common-protos==1.72.0
+ grpc-google-iam-v1==0.14.3
+ grpcio==1.76.0
+ grpcio-status==1.76.0
+ h11==0.16.0
+ hf-xet==1.2.0
+ httpcore==1.0.9
+ httplib2==0.31.0
+ httpx==0.28.1
+ httpx-sse==0.4.3
+ huggingface-hub==1.1.2
+ idna==3.11
+ iniconfig==2.3.0
+ jiter==0.12.0
+ jsonpatch==1.33
+ jsonpointer==3.0.0
+ langchain==1.0.5
+ langchain-core==1.1.0
+ langchain-google-vertexai==3.1.1 (from file:///workspace/libs/vertexai)
+ langchain-mistralai==1.0.1
+ langchain-tests==1.0.1
+ langgraph==1.0.3
+ langgraph-checkpoint==3.0.1
+ langgraph-prebuilt==1.0.2
+ langgraph-sdk==0.2.9
+ langsmith==0.4.42
+ markdown-it-py==4.0.0
+ mdurl==0.1.2
+ multidict==6.7.0
+ numexpr==2.14.1
+ numpy==2.3.4
+ orjson==3.11.4
+ ormsgpack==1.12.0
+ packaging==25.0
+ pluggy==1.6.0
+ propcache==0.4.1
+ proto-plus==1.26.1
+ protobuf==6.33.0
+ py-cpuinfo==9.0.0
+ pyarrow==22.0.0
+ pyasn1==0.6.1
+ pyasn1-modules==0.4.2
+ pycparser==2.23
+ pydantic==2.12.4
+ pydantic-core==2.41.5
+ pygments==2.19.2
+ pyparsing==3.2.5
+ pytest==8.4.2
+ pytest-asyncio==1.3.0
+ pytest-benchmark==5.2.3
+ pytest-codspeed==4.2.0
+ pytest-mock==3.15.1
+ pytest-order==1.3.0
+ pytest-recording==0.13.4
+ pytest-retry==1.7.0
+ pytest-socket==0.7.0
+ pytest-watcher==0.4.3
+ pytest-xdist==3.8.0
+ python-dateutil==2.9.0.post0
+ pyyaml==6.0.3
+ requests==2.32.5
+ requests-toolbelt==1.0.0
+ rich==14.2.0
+ rsa==4.9.1
+ shapely==2.1.2
+ shellingham==1.5.4
+ six==1.17.0
+ sniffio==1.3.1
+ syrupy==4.9.1
+ tenacity==9.1.2
+ tokenizers==0.22.1
+ tqdm==4.67.1
+ typer-slim==0.20.0
+ types-protobuf==4.25.0.20240417
+ types-requests==2.32.4.20250913
+ typing-extensions==4.15.0
+ typing-inspection==0.4.2
+ uritemplate==4.2.0
+ urllib3==2.5.0
+ validators==0.35.0
+ vcrpy==7.0.0
+ watchdog==6.0.0
+ websockets==15.0.1
+ wrapt==2.0.1
+ xxhash==3.6.0
+ yarl==1.22.0
+ zstandard==0.25.0
============================= test session starts ==============================
platform linux -- Python 3.11.14, pytest-8.4.2, pluggy-1.6.0
codspeed: 4.2.0 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns)
benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /workspace/libs/vertexai
configfile: pyproject.toml
plugins: benchmark-5.2.3, asyncio-1.3.0, codspeed-4.2.0, anyio-4.11.0, socket-0.7.0, order-1.3.0, mock-3.15.1, recording-0.13.4, syrupy-4.9.1, xdist-3.8.0, retry-1.7.0, langsmith-0.4.42
asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
collected 271 items
tests/integration_tests/test_anthropic_cache.py ssss [ 1%]
tests/integration_tests/test_anthropic_files.py ... [ 2%]
tests/integration_tests/test_anthropic_long_context.py ss [ 3%]
tests/integration_tests/test_callbacks.py .... [ 4%]
tests/integration_tests/test_chains.py ... [ 5%]
tests/integration_tests/test_chat_models.py ..x..x............R..X...... [ 15%]
........R.R.................Xx....XX.......... [ 32%]
tests/integration_tests/test_compile.py . [ 32%]
tests/integration_tests/test_embeddings.py ......... [ 35%]
tests/integration_tests/test_evaluation.py ...x [ 37%]
tests/integration_tests/test_image_utils.py s [ 37%]
tests/integration_tests/test_llms.py ...x...... [ 41%]
tests/integration_tests/test_llms_safety.py .. [ 42%]
tests/integration_tests/test_maas.py ............................s [ 52%]
tests/integration_tests/test_model_garden.py ................ [ 58%]
tests/integration_tests/test_standard.py sssssssssssssssssssssssssssssss [ 70%]
sssssssssssss...................................sss...s.x [ 91%]
tests/integration_tests/test_vectorstores.py .................ss. [ 98%]
tests/integration_tests/test_vision_models.py sss. [100%]
=============================== warnings summary ===============================
tests/integration_tests/test_anthropic_files.py::test_pdf_gcs_uri
tests/integration_tests/test_chat_models.py::test_multimodal
tests/integration_tests/test_chat_models.py::test_multimodal
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching_tools
tests/integration_tests/test_chat_models.py::test_context_catching_tools
tests/integration_tests/test_chat_models.py::test_multimodal_pdf_input_gcs
/workspace/libs/vertexai/langchain_google_vertexai/_image_utils.py:204: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(gcs_uri, gcs_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[video]
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[audio]
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64[image]
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:310: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64_template
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:354: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64_agent
<frozen abc>:106: LangGraphDeprecatedSinceV10: AgentStatePydantic has been moved to `langchain.agents`. Please update your import to `from langchain.agents import AgentStatePydantic`. Deprecated in LangGraph V1.0 to be removed in V2.0.
tests/integration_tests/test_chat_models.py::test_multimodal_media_inline_base64_agent
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:383: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_audio_timestamp
tests/integration_tests/test_chat_models.py::test_audio_timestamp
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:412: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_parse_history_gemini_multimodal_FC
/workspace/libs/vertexai/tests/integration_tests/test_chat_models.py:439: PendingDeprecationWarning: Blob.from_string() is deprecated and will be removed in future. Use Blob.from_uri() instead.
blob = storage.Blob.from_string(file_uri, client=storage_client)
tests/integration_tests/test_chat_models.py::test_context_catching
tests/integration_tests/test_chat_models.py::test_context_catching_tools
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/caching/_caching.py:161: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_evaluation.py::test_evaluate_pairwise
/workspace/libs/vertexai/langchain_google_vertexai/evaluators/_core.py:62: UserWarning: Ignoring input in VertexPairWiseStringEvaluator, as it is not expected.
warn(self._skip_input_warning)
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/_model_garden/_model_garden_models.py:278: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/vision_models/_vision_models.py:1437: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
tests/integration_tests/test_vision_models.py::test_vertex_ai_image_generation_and_edition
/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/vertexai/vision_models/_vision_models.py:154: UserWarning: This feature is deprecated as of June 24, 2025 and will be removed on June 24, 2026. For details, see https://cloud.google.com/vertex-ai/generative-ai/docs/deprecations/genai-vertexai-sdk.
warning_logs.show_deprecation_warning()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=================================== XPASSES ====================================
======================= the following tests were retried =======================
test_audio_timestamp failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: assert None
+ where None = <function search at 0x7fd17df153a0>('(\\d{2}:\\d{2}:?|\\[\\d{2}:\\d{2}:\\d{2}\\])', "Google's offices and data centers around the world run on electricity, and we're determined to power them with carbon..., we are helping bring Google and the world one step closer to running on carbon-free energy, every hour of every day.")
+ where <function search at 0x7fd17df153a0> = re.search
+ and "Google's offices and data centers around the world run on electricity, and we're determined to power them with carbon..., we are helping bring Google and the world one step closer to running on carbon-free energy, every hour of every day." = AIMessage(content="Google's offices and data centers around the world run on electricity, and we're determined to powe..._metadata={'input_tokens': 2509, 'output_tokens': 333, 'total_tokens': 2842, 'input_token_details': {'cache_read': 0}}).content
test_audio_timestamp passed on attempt 2!
test_chat_vertexai_gemini_image_output failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: Did not find the expected text content
assert None is not None
test_chat_vertexai_gemini_image_output passed on attempt 2!
test_chat_vertexai_gemini_image_output_with_generation_config failed on attempt 1! Retrying!
Traceback (most recent call last):
File "/workspace/libs/vertexai/.venv/lib/python3.11/site-packages/_pytest/runner.py", line 344, in from_call
result: TResult | None = func()
^^^^^^
AssertionError: Did not find the expected text content
assert None is not None
test_chat_vertexai_gemini_image_output_with_generation_config passed on attempt 2!
=========================== end of test retry report ===========================
============================= slowest 5 durations ==============================
344.48s call tests/integration_tests/test_model_garden.py::test_model_garden[FALCON_ENDPOINT_ID-generated_text]
89.73s call tests/integration_tests/test_model_garden.py::test_model_garden_agenerate[FALCON_ENDPOINT_ID-generated_text]
64.73s call tests/integration_tests/test_chat_models.py::test_context_catching_tools
59.04s call tests/integration_tests/test_chat_models.py::test_context_catching
53.38s call tests/integration_tests/test_model_garden.py::test_model_garden_generate[FALCON_ENDPOINT_ID-generated_text]
=========================== short test summary info ============================
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:12: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:36: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:72: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_cache.py:116: claude-3-5-v2 not enabled
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:54: too long & expensive
SKIPPED [1] tests/integration_tests/test_anthropic_long_context.py:69: too long & expensive
SKIPPED [1] tests/integration_tests/test_image_utils.py:8: CI testing not set up
SKIPPED [1] tests/integration_tests/test_maas.py:82: got empty parameter set for (model_name)
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/base.py: need --first option to run
SKIPPED [26] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:785: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:823: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1365: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:1975: need --first option to run
SKIPPED [3] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2058: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2140: need --first option to run
SKIPPED [2] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3042: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3112: need --first option to run
SKIPPED [1] tests/integration_tests/test_standard.py:63: need --first option to run
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2697: Model does not support image tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2796: Model does not support PDF tool message.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:2910: Model does not explicitly support Anthropic inputs.
SKIPPED [1] .venv/lib/python3.11/site-packages/langchain_tests/integration_tests/chat_models.py:3141: VCR not set up.
SKIPPED [1] tests/integration_tests/test_vectorstores.py:329: rebuild the index with restricts
SKIPPED [1] tests/integration_tests/test_vectorstores.py:353: need --long option to run
SKIPPED [1] tests/integration_tests/test_vision_models.py:14: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:53: Image captioning is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
SKIPPED [1] tests/integration_tests/test_vision_models.py:68: Visual question answering is deprecated: https://cloud.google.com/vertex-ai/generative-ai/docs/image/image-captioning
XFAIL tests/integration_tests/test_chat_models.py::test_init_from_credentials_obj - can't create service account key on gcp
XFAIL tests/integration_tests/test_chat_models.py::test_candidates - vertex api doesn't respect n/candidate_count
XFAIL tests/integration_tests/test_chat_models.py::test_label_metadata_invoke_method - can't add labels to the gemini content using invoke method
XFAIL tests/integration_tests/test_evaluation.py::test_evaluate_pairwise - TODO: investigate (started failing 2025-03-25).
XFAIL tests/integration_tests/test_llms.py::test_vertex_generate_multiple_candidates - VertexAI doesn't always respect number of candidates
XFAIL tests/integration_tests/test_standard.py::TestGemini_15_AIStandard::test_audio_inputs - [NOTRUN] Multimodal tests require integration secrets (user agent to fetch external resources)
XPASS tests/integration_tests/test_chat_models.py::test_multimodal_video_metadata[video] - investigating
XPASS tests/integration_tests/test_chat_models.py::test_label_metadata - can't add labels to the gemini content
XPASS tests/integration_tests/test_chat_models.py::test_logprobs - logprobs are subject to daily quotas
XPASS tests/integration_tests/test_chat_models.py::test_logprobs_with_json_schema - logprobs are subject to daily quotas
= 200 passed, 61 skipped, 6 xfailed, 4 xpassed, 23 warnings, 3 retried in 1546.56s (0:25:46) =
PUSH
DONE
Loading