Skip to content

CI flake: Test Suite #6628

Closed as duplicate
Closed as duplicate

Description

@clockwork-labs-bot

Detected by CI Gremlin after a failed GitHub Actions attempt succeeded on rerun.

Tests:

  • Test Suite

Error:
Process completed with exit code 1.
Cleaning up orphan processes

Failed job runs:

Timeout detection:

  • none

Context:

  • none

Activity

  1. clockwork-labs-bot commented on Nov 18, 2026

    @clockwork-labs-bot
    ContributorAuthor

    Symptoms and root cause

    Exact aggregate job 134965476783, run 44345845742, attempt 1, exits 1 because RUST_RESULT=cancelled and RUST_SERIAL_RESULT=cancelled; the other five components are success. Following this wrapper identifies the two substantive archive timeouts:

    • Run 44345845742, attempt 1, Rust Serial & Features job 134957207614: feature tests passed 9/9 and 3/3, then Download Rust test archive spent 8m30s (16:35:14–16:43:44 UTC) handling rust-tests-linux (5,635,192,888 bytes). No completion/digest message followed; the ten-minute job limit expired and serial integration tests were skipped.
    • Run 44345845742, attempt 1, Rust (1/4) job 134957209290: Download Rust test archive spent 9m52s (16:34:55–16:44:47 UTC) handling rust-tests-linux (5,635,192,888 bytes) without a completion/digest message. The ten-minute job limit expired; Run Rust test partition was skipped.

    The exact check-run annotations confirm The job has exceeded the maximum execution time of 10m0s. This is archive transfer/handling exhausting the shared job budget, not cancellation-only or an observed test hang. The logs cannot distinguish network, storage/extraction, or another artifact-action bottleneck.

    Exact attempt 2 serial job 134965770337 downloaded the archive in 1m53s and passed the 9 + 3 feature tests and 48 serial tests; Rust job 134965771825 downloaded it in 2m30s and passed 394/394 shard tests. Aggregate job 134969300866 succeeded. GitHub's public attempt-2 jobs-list endpoint returned HTTP 502; retry IDs were recovered from the check suite and independently verified through each exact job metadata/log endpoint.

    Duplicate selection

    Searched all 107 open Test flakes project issues across repositories, plus organization-wide open archive, timeout and diagnostic searches. Selected #6330: the same specific large Rust archive transfer/handling exhausts the shard job budget. The open root explicitly consolidates both shard and serial manifestations and had 46 distinct incoming canonical duplicate sources before this invocation. Artifact-listing connection reset (#6535), checksum mismatch (#6369), and every-component-skipped aggregate (#5930) have different diagnostics. No closed candidate tickets were searched or inspected.

    Proposed operations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions