Skip to content

Eager Eviction Leads to Not Found Error #1943

@MarcusSorealheis

Description

@MarcusSorealheis
INFO: Analyzed 262 targets (1791 packages loaded, 72437 targets configured).
ERROR: D:/workdir/servicemesh/src/third_party/zot/BUILD.bazel:62:14: OCI Image //src/third_party/zot:zot-windows-process failed: Failed to fetch blobs because they do not exist remotely.: 3 errors during bulk transfer:
com.google.devtools.build.lib.remote.common.CacheNotFoundException: Missing digest: 8529e83aa16541b76e5351d0f82fb57fa670fa9989a52085ba33a8787a751f7f/351 for bazel-out/x64_windows-opt/bin/src/third_party/zot/zot-windows-process.0.descriptor.json
com.google.devtools.build.lib.remote.common.CacheNotFoundException: Missing digest: 7c183cd3a038fc1a5f5a388cea63507cb7e6570e7528d0151b470c6f59fdf542/357 for bazel-out/x64_windows-opt/bin/src/third_party/zot/zot-windows-process.1.descriptor.json
com.google.devtools.build.lib.remote.common.CacheNotFoundException: Missing digest: c92df9d4b7c63e91d9e9ff65f947dbd641d286a9ed33dd48bad663897f9c2e9f/359 for bazel-out/x64_windows-opt/bin/src/third_party/zot/zot-windows-process.2.descriptor.json
INFO: Elapsed time: 265.487s, Critical Path: 64.65s
INFO: 2122 processes: 96 remote cache hit, 2016 internal, 10 local.
ERROR: Build did NOT complete successfully
2025-09-25T05:46:00.401435Z ERROR nativelink_service::bytestream_server: response: Error { code: NotFound, messages: ["Object c92df9d4b7c63e91d9e9ff65f947dbd641d286a9ed33dd48bad663897f9c2e9f-359 not found in either fast or slow store"] }
    at nativelink-service/src/bytestream_server.rs:369
    in nativelink_service::bytestream_server::read_stream
    in nativelink_service::bytestream_server::bytestream_read
    in nativelink_service::bytestream_server::read with request: ReadRequest { resource_name: "dev/blobs/c92df9d4b7c63e91d9e9ff65f947dbd641d286a9ed33dd48bad663897f9c2e9f/359", read_offset: 0, read_limit: 0 }
    in nativelink_util::task::http_executor
    in nativelink::services::http_connection with remote_addr: 10.146.124.187:50538, socket_addr: 0.0.0.0:50051

AND

2025-09-25T03:16:30.884493Z ERROR nativelink_worker::local_worker: Error executing action, err: Error { code: NotFound, messages: ["Object 7fd25e01d12373a2d1712e446881c9246a9698da4e7eafecdaeeaaff62195a82-148 not found in either fast or slow store", "During start_action"] }`

 
{"timestamp":"2025-09-24T09:46:47.218102Z","level":"ERROR","fields":{"response":"Error { code: NotFound, messages: [\"Object 60b6c7dde5259415e3cd4dc6bf3efe36c6e8c79a9c6a397dcd46e957930c4d45-83 not found in either fast or slow store\"] }"},"target":"nativelink_service::bytestream_server","span":{"name":"read_stream"},"spans":[{"remote_addr":"10.112.2.74:45780","socket_addr":"0.0.0.0:50051","name":"http_connection"},{"name":"http_executor"},{"request":"ReadRequest { resource_name: \"main/blobs/sha256/60b6c7dde5259415e3cd4dc6bf3efe36c6e8c79a9c6a397dcd46e957930c4d45/83\", read_offset: 0, read_limit: 0 }","name":"read"},{"name":"bytestream_read"},{"name":"read_stream"}]}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions