Skip to content

add exact rv1106 pipeline9 pathing repro - #2534

Open
mohan-bee wants to merge 7 commits into
mainfrom
codex/rv1106-pathing-repro
Open

add exact rv1106 pipeline9 pathing repro#2534
mohan-bee wants to merge 7 commits into
mainfrom
codex/rv1106-pathing-repro

Conversation

@mohan-bee

@mohan-bee mohan-bee commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Motivation

  • Capture the exact RV1106 Pipeline 9 path-planning slowdown for review.

Before

  • The board has no focused regression test or path-planning snapshot in the autorouter.

After

  • The test loads the exact input fixture and records the path-planning result in an SVG snapshot.

@vercel

vercel Bot commented Sep 10, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
capacity-node-autorouter Ready Ready Preview Sep 11, 2026 2:22pm UTC

Request Review

@tscircuitbot

Copy link
Copy Markdown
Contributor

Benchmark This PR

Run benchmarks by commenting on this PR:

/benchmark [benchmark.sh args...]
/benchmark-long [benchmark.sh args...]
/benchmark-all [benchmark.sh args except --dataset]
/benchmark --same-machine
/benchmark-all --same-machine
/profile --dataset 18

Comment /benchmark to compare current main and the PR head sequentially on the same 8-vCPU Blacksmith runner using the default dataset, or append any arguments accepted by ./benchmark.sh. Same-machine comparison is enabled by default, except for --pipeline 9net, which uses its dedicated cold/hot benchmark workflow.
Comment /benchmark-long for an 8-vCPU run that defaults to 8 workers and has an eight-hour timeout.
Comment /benchmark-all to start separate workflow runs and result comments for dataset01 and dataset18. You may append benchmark arguments such as --pipeline 9; --dataset is not accepted because the command selects both datasets.
Append --same-machine to /benchmark-long or /benchmark-all to compare current main and the PR head sequentially on the same 8-vCPU Blacksmith runner.
Comment /profile --dataset 18 to compare direct Pipeline 7 stage-time percentages between current main and the PR head sequentially on one Blacksmith runner.

Everything after /benchmark, /benchmark-long, or /benchmark-all is safely forwarded to ./benchmark.sh, except --profile-solvers, which enables profile comparison tables, and --same-machine, which enables the paired runner.
Examples: /benchmark --dataset 18 --sample-timeout 2000s, /benchmark --pipeline 10 --dataset 29, /benchmark --pipeline 10 --dataset 29 --sample 1, /benchmark --pipeline 7 --limit 20, /benchmark all 20 --concurrency 8, /benchmark --same-machine, /benchmark-all --pipeline 9 --same-machine, and /benchmark-long --dataset 18.

Use /update-snapshots (or /us) to run BUN_UPDATE_SNAPSHOTS=1 bun test --timeout 120_000 on the PR branch and auto-commit snapshot updates.
Use /usf to read recent failed test files, update and verify their exact CI test shards, and auto-commit only their snapshots. It uses the configured fast benchmark runner by default; use /usf --ubuntu-latest for GitHub-hosted x64 CI parity.

Any PR whose title contains [BENCHMARK TEST] will automatically run one default-dataset benchmark on PR updates; it does not post a PR result comment.

@mohan-bee
mohan-bee force-pushed the codex/rv1106-pathing-repro branch from 315a5a3 to 68ea510 Compare September 11, 2026 10:00
@mohan-bee mohan-bee changed the title reproduce rv1106 pipeline9 path-search runtime add exact rv1106 pipeline9 pathing repro Sep 11, 2026
@mohan-bee

Copy link
Copy Markdown
Contributor Author

/benchmark --pipeline 9 --dataset srj18 --same-machine

@tscircuitbot

tscircuitbot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Same Machine Benchmark Results

Both revisions ran sequentially in one Blacksmith job on blacksmith-01m28bcy92755xd2w7k86wma5q-8vcpu.

Dataset: srj18 · Scenarios: 16
Main: 109c67b · PR: 68ea510

Solver Metric Main PR Delta
Pipeline9 Completion 81.3% (🕒6.3%) 81.3% (🕒6.3%) 0.0 pp
Pipeline9 Relaxed DRC pass 81.3% (🕒6.3%) 81.3% (🕒6.3%) 0.0 pp
Pipeline9 DRC issues 0 0 0
Pipeline9 Timeouts 1 1 0
Pipeline9 P50 time 90.0s 87.9s -2.4%
Pipeline9 P60 time 114.7s 116.2s +1.3%
Pipeline9 P70 time 216.1s 211.7s -2.0%
Pipeline9 P80 time 230.4s 226.3s -1.8%
Pipeline9 P90 time 249.5s 250.5s +0.4%
Pipeline9 P95 time 291.1s 294.0s +1.0%
Pipeline9 Average vias 208.54 208.54 0.0%

Outcome changes: 0 improved, 0 regressed. DRC issues are totaled across solved samples. Timing percentiles include solved and timed-out samples; negative timing deltas are faster.

Main pipeline stage timings

AutoroutingPipelineSolver9_PreloadedTraceGraph

Recorded timings: 16/16 samples (3 partial, including failed or timed-out samples).
Times are summed across samples; percentages use the total recorded stage time for this solver.

Stage Total time % of stage time
preprocessSimpleRouteJsonSolver 3.350s 0.2%
componentDetectionSolver 0.187s 0.0%
escapeViaLocationSolver 0.585s 0.0%
netToPointPairsSolver 0.743s 0.0%
topologyPlanningSolver 17.770s 0.8%
topologyMergingSolver 19.868s 0.9%
nodeDimensionSubdivisionSolver 0.304s 0.0%
edgeSolver 4.485s 0.2%
availableSegmentPointSolver 1.027s 0.0%
necessaryCrampedPortPointSolver 4.075s 0.2%
preloadedTraceGraphSolver 0.106s 0.0%
portPointPathingSolver 509.114s 23.6%
uniformPortDistributionSolver 4.437s 0.2%
highDensityRouteSolver 1041.623s 48.3%
highDensityForceImproveSolver 20.183s 0.9%
highDensityRepairSolver 0.006s 0.0%
highDensityStitchSolver 1.622s 0.1%
traceSimplificationSolver 122.867s 5.7%
mutatedPreloadedTraceSimplificationSolver 0.286s 0.0%
traceWidthSolver 23.099s 1.1%
globalDrcForceImproveSolver 56.209s 2.6%
pipeline9JointDrcRepairSolver 322.924s 15.0%
lengthMatchingPostProcessingSolver 0.581s 0.0%
powerTraceExpansionSolver 0.001s 0.0%
Total 2155.447s 100.0%
PR pipeline stage timings

AutoroutingPipelineSolver9_PreloadedTraceGraph

Recorded timings: 16/16 samples (3 partial, including failed or timed-out samples).
Times are summed across samples; percentages use the total recorded stage time for this solver.

Stage Total time % of stage time
preprocessSimpleRouteJsonSolver 3.137s 0.1%
componentDetectionSolver 0.178s 0.0%
escapeViaLocationSolver 0.552s 0.0%
netToPointPairsSolver 0.619s 0.0%
topologyPlanningSolver 18.558s 0.9%
topologyMergingSolver 17.473s 0.8%
nodeDimensionSubdivisionSolver 0.351s 0.0%
edgeSolver 3.993s 0.2%
availableSegmentPointSolver 1.211s 0.1%
necessaryCrampedPortPointSolver 3.770s 0.2%
preloadedTraceGraphSolver 0.104s 0.0%
portPointPathingSolver 472.305s 22.1%
uniformPortDistributionSolver 4.441s 0.2%
highDensityRouteSolver 1057.924s 49.6%
highDensityForceImproveSolver 20.453s 1.0%
highDensityRepairSolver 0.005s 0.0%
highDensityStitchSolver 1.522s 0.1%
traceSimplificationSolver 127.099s 6.0%
mutatedPreloadedTraceSimplificationSolver 0.310s 0.0%
traceWidthSolver 23.144s 1.1%
globalDrcForceImproveSolver 57.370s 2.7%
pipeline9JointDrcRepairSolver 317.944s 14.9%
lengthMatchingPostProcessingSolver 0.581s 0.0%
powerTraceExpansionSolver 0.001s 0.0%
Total 2133.044s 100.0%

Workflow: View run
Artifact: Download raw reports

@tscircuitbot

tscircuitbot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Same Machine Benchmark Results

Both revisions ran sequentially in one Blacksmith job on blacksmith-01m28ctht89am83tnrbjcq8e43-8vcpu.

Dataset: srj18 · Scenarios: 16
Main: 109c67b · PR: 7b225af

Solver Metric Main PR Delta
Pipeline9 Completion 81.3% (🕒6.3%) 81.3% (🕒6.3%) 0.0 pp
Pipeline9 Relaxed DRC pass 81.3% (🕒6.3%) 81.3% (🕒6.3%) 0.0 pp
Pipeline9 DRC issues 0 0 0
Pipeline9 Timeouts 1 1 0
Pipeline9 P50 time 99.3s 94.0s -5.3%
Pipeline9 P60 time 123.5s 120.9s -2.1%
Pipeline9 P70 time 229.2s 223.5s -2.5%
Pipeline9 P80 time 239.5s 232.1s -3.1%
Pipeline9 P90 time 257.3s 258.3s +0.4%
Pipeline9 P95 time 295.9s 298.7s +0.9%
Pipeline9 Average vias 208.54 208.54 0.0%

Outcome changes: 0 improved, 0 regressed. DRC issues are totaled across solved samples. Timing percentiles include solved and timed-out samples; negative timing deltas are faster.

Main pipeline stage timings

AutoroutingPipelineSolver9_PreloadedTraceGraph

Recorded timings: 16/16 samples (3 partial, including failed or timed-out samples).
Times are summed across samples; percentages use the total recorded stage time for this solver.

Stage Total time % of stage time
preprocessSimpleRouteJsonSolver 3.412s 0.2%
componentDetectionSolver 0.187s 0.0%
escapeViaLocationSolver 0.645s 0.0%
netToPointPairsSolver 0.718s 0.0%
topologyPlanningSolver 18.992s 0.8%
topologyMergingSolver 20.152s 0.9%
nodeDimensionSubdivisionSolver 0.290s 0.0%
edgeSolver 4.824s 0.2%
availableSegmentPointSolver 1.352s 0.1%
necessaryCrampedPortPointSolver 4.529s 0.2%
preloadedTraceGraphSolver 0.099s 0.0%
portPointPathingSolver 571.774s 25.2%
uniformPortDistributionSolver 4.429s 0.2%
highDensityRouteSolver 1057.206s 46.5%
highDensityForceImproveSolver 20.944s 0.9%
highDensityRepairSolver 0.006s 0.0%
highDensityStitchSolver 1.759s 0.1%
traceSimplificationSolver 130.380s 5.7%
mutatedPreloadedTraceSimplificationSolver 0.341s 0.0%
traceWidthSolver 24.167s 1.1%
globalDrcForceImproveSolver 58.630s 2.6%
pipeline9JointDrcRepairSolver 346.799s 15.3%
lengthMatchingPostProcessingSolver 0.604s 0.0%
powerTraceExpansionSolver 0.001s 0.0%
Total 2272.241s 100.0%
PR pipeline stage timings

AutoroutingPipelineSolver9_PreloadedTraceGraph

Recorded timings: 16/16 samples (3 partial, including failed or timed-out samples).
Times are summed across samples; percentages use the total recorded stage time for this solver.

Stage Total time % of stage time
preprocessSimpleRouteJsonSolver 3.348s 0.2%
componentDetectionSolver 0.196s 0.0%
escapeViaLocationSolver 0.627s 0.0%
netToPointPairsSolver 0.844s 0.0%
topologyPlanningSolver 19.247s 0.9%
topologyMergingSolver 20.413s 0.9%
nodeDimensionSubdivisionSolver 0.382s 0.0%
edgeSolver 4.553s 0.2%
availableSegmentPointSolver 1.079s 0.0%
necessaryCrampedPortPointSolver 3.954s 0.2%
preloadedTraceGraphSolver 0.084s 0.0%
portPointPathingSolver 489.470s 22.3%
uniformPortDistributionSolver 4.574s 0.2%
highDensityRouteSolver 1072.277s 48.9%
highDensityForceImproveSolver 21.074s 1.0%
highDensityRepairSolver 0.005s 0.0%
highDensityStitchSolver 1.669s 0.1%
traceSimplificationSolver 129.162s 5.9%
mutatedPreloadedTraceSimplificationSolver 0.303s 0.0%
traceWidthSolver 24.077s 1.1%
globalDrcForceImproveSolver 57.983s 2.6%
pipeline9JointDrcRepairSolver 338.273s 15.4%
lengthMatchingPostProcessingSolver 0.583s 0.0%
powerTraceExpansionSolver 0.001s 0.0%
Total 2194.178s 100.0%

Workflow: View run
Artifact: Download raw reports

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants