Skip to content

Releases: pytorch/test-infra

v20251112-220849

12 Nov 22:10
9571290

Choose a tag to compare

[Add notification for Pytorch Operator Microbenchmark (#7447)

## Overview
Add notification for pytorch  operator microbenchmark
Add median option as option to choose the median value as baseline

the data visualization example;

https://hud.pytorch.org/benchmark/regression/report/acfae3e8-7680-403b-a234-79e5c194f4c0

## Bug Fix
1. [Notification] return skip when timeseries from api resp is empty
list, not the class object
2. [API] fix the emptyTimeseriesResponse to match the response format
with the data one

## Next step
Add search filter for regression report

v20251105-232748

05 Nov 23:29
bc5f540

Choose a tag to compare

[autorevert] use 'tests.all_test_runs' instead of 'default.test_run_s…

v20251105-183009

05 Nov 18:32
0021389

Choose a tag to compare

[autorevert] combine test outcomes across shards, prioritizing failur…

v20251104-230454

04 Nov 23:06
d66d31f

Choose a tag to compare

[CH] swap all_test_runs to be in tests database, use different source…

v20251024-231247

24 Oct 23:14
0ffc3c1

Choose a tag to compare

[autorevert] add 'slow' workflow (#7411)

### Testing

```
python -m pytorch_auto_revert --dry-run autorevert-checker slow --hours 18  --hud-html
2025-10-24 15:22:34,841 INFO [root] [v2] Start: workflows=slow hours=18 repo=pytorch/pytorch restart_action=log revert_action=log notify_issue_number=163650 bisection=unlimited
2025-10-24 15:22:34,842 INFO [root] [v2] Run timestamp (CH log ts) = 2025-10-24T22:22:34.841907+00:00
2025-10-24 15:22:34,842 INFO [pytorch_auto_revert.signal_extraction_datasource] [extract] Fetching commits in time range: repo=pytorch/pytorch lookback=18h
2025-10-24 15:22:35,923 INFO [pytorch_auto_revert.signal_extraction_datasource] [extract] Commits fetched: 19 commits in 1.08s
2025-10-24 15:22:35,923 INFO [pytorch_auto_revert.signal_extraction_datasource] [extract] Fetching jobs: repo=pytorch/pytorch workflows=slow commits=19 lookback=18h
2025-10-24 15:23:12,303 INFO [pytorch_auto_revert.signal_extraction_datasource] [extract] Jobs fetched: 370 rows in 36.38s
2025-10-24 15:23:12,307 INFO [root] [v2] Extracted 2 signals
2025-10-24 15:23:12,307 INFO [root] [v2][signal] wf=slow key=linux-jammy-py3.10-clang18-asan / test outcome=Ineligible(reason=<IneligibleReason.FIXED: 'fixed'>, message='signal appears recovered at head')
2025-10-24 15:23:12,307 INFO [root] [v2][signal] wf=slow key=linux-jammy-py3.10-clang12 / test outcome=Ineligible(reason=<IneligibleReason.FIXED: 'fixed'>, message='signal appears recovered at head')
2025-10-24 15:23:12,307 INFO [root] [v2] Candidate action groups: 0
2025-10-24 15:23:12,307 INFO [root] [v2] Executed action groups: 0
2025-10-24 15:23:13,071 INFO [root] [v2] State logged
2025-10-24 15:23:13,072 INFO [root] [hud] Rendering HTML for repo=pytorch/pytorch workflows=slow lookback=18 → 2025-10-24T22-22-34.841907-00-00.html
2025-10-24 15:23:13,075 INFO [root] HUD written to 2025-10-24T22-22-34.841907-00-00.html
```

v20251022-232450

22 Oct 23:26
db4893e

Choose a tag to compare

[autorevert] requires same revision retry failure for job-track signa…

v20251022-232435

22 Oct 23:26
6498804

Choose a tag to compare

[autorevert] treat test failures as successes in job-track Signals (#…

v20251022-210140

22 Oct 21:03
b6cfb0d

Choose a tag to compare

Try putting all test run info into clickhouse (#7347)

See how well clickhouse handles having all test run info

Companion to https://github.com/pytorch/pytorch/pull/165484/files

v20251021-212524

21 Oct 21:27
433cd56

Choose a tag to compare

[autorevert] correctly fetch ghstack commits (#7291)

Ghstack commits are nested inside a single push event. Fortunately, the
webhook has this information, we just need to unroll the list.


Testing:

[2025-10-03T19-16-15.103579-00-00.html](https://github.com/user-attachments/files/22686819/2025-10-03T19-16-15.103579-00-00.html)


see this stack there:
```
Tue 10:43 am	5ed4672	[dynamo, 3.14] fix _detect_and_normalize_assert_statement for 3.14 (#164005)	
#164005
williamwen42
Tue 10:43 am	2600f8b	[dynamo, 3.14] fix tracing typing.Union (#164004)	
#164004
williamwen42
Tue 10:42 am	9ce31e4	[3.14] make unbacked_sym[int/float]_counter integers (#163920)	
#163920
williamwen42
Tue 10:42 am	0657de9	[dynamo, 3.14] support LOAD_COMMON_CONSTANT (#163919)	
#163919
williamwen42
Tue 10:42 am	4ead8eb	[dynamo, 3.14] fix BUILD_TUPLE with 0 args (#163818)	
#163818
williamwen42
Tue 10:42 am	d4b785a	[dynamo, 3.14] fix stack ref copy error (#163796)	
#163796
williamwen42
Tue 10:42 am	9278b18	[dynamo, 3.14] fix WITH_EXCEPT_START (#163292)	
#163292
williamwen42
Tue 10:42 am	008b0a9	[dynamo, 3.14] fix inactive ctx handling in resume functions (#163191)	
#163191
williamwen42
Tue 10:42 am	44677ad	[dynamo, 3.14] support LOAD_CONST on slice, codegen LOAD_CONST slice instead of BINARY/STORE_SLICE (#163110)	
#163110
williamwen42
Tue 10:42 am	1c9987f	[dynamo, 3.14] fix context managers (#163109)	
#163109
williamwen42
Tue 10:41 am	7cbc011	[dynamo, 3.14] support some bytecodes, fix CALL_FUNCTION_EX (#163009)	
#163009
williamwen42
Tue 10:41 am	09c7741	[dynamo, 3.14] Python dynamo changes to get basic programs working (#161839)	
#161839
williamwen42
Tue 10:41 am	763ab2a	[dynamo, 3.14] compile actual code in C dynamo (#161555)	
#161555
williamwen42
Tue 10:41 am	4b8fe79	[dynamo] format cpython_defs.c (#161838)	
#161838
williamwen42
```

v20251018-044301

18 Oct 04:44
a287d59

Choose a tag to compare

Add vllm_buildkite_agents table (#7365)

The PR to create the new table on test-infra side. I have test the query
on `fortesting` table to start with.

cc @hl475

---------

Signed-off-by: Huy Do <[email protected]>