Update dataset31 to 72 samples and refresh benchmark results - #197
Open
seveibar wants to merge 2 commits into
Open
Update dataset31 to 72 samples and refresh benchmark results#197seveibar wants to merge 2 commits into
seveibar wants to merge 2 commits into
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
seveibar
marked this pull request as ready for review
September 9, 2026 04:21
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Updates the dataset31 dependency from
145d7446c9244b86b1e38288f602b9312ffde3e4to latest merged revision637a6566a011be520b4fd170ad3f6da696ad4ff9, adding 12 i.MX6ULL, 12 T113-S3, and 12 AM3352 cases to the existing 36 AM62L/RK3308/K230 cases.The benchmark catalog, capture factories, CLI/report descriptions, and documentation now cover all 72 samples. Capture tests verify complete pin coverage, NC pad obstacles, plane assignments, allowed layers, bus exits, and differential-pair constraints. Solver routing code and runtime dependencies remain unchanged from main
733d44a.The complete benchmark on
5f40c84d8aafccc8688b85621801f6e885b9ac13scored 18/72 (25%) with four workers, a 120-second deadline per sample, and original assignment budgets. Timed wall duration was 1,807.493 seconds (30m 7.5s), excluding input capture.All 72 cases completed: 18 solved, 54 timeouts, no partials or errors. The original 36 cases retain their exact 18/36 baseline statuses. The additional 36 cases all timed out under the current main solver.
Updated
benchmark-results/benchmark.jsonandbenchmark-results/benchmark.mdrecord the full run. Every passing case has its committed SVG underbenchmark-results/; all 18 regenerated passing SVGs are byte-for-byte identical to the existing snapshots, so no SVG diff is needed. There are no stale success SVGs for failed cases.Validation: eight integration tests passed with 4,647 assertions; typecheck and formatting passed. All eight CI test shards, aggregate test check, typecheck, and format check passed for measured code commit
5f40c84. Independent report verification confirmed 72 unique ordered rows, exact dataset provenance and budgets, full connection validation for every pass, and an exact match between passing rows and SVG files.