Skip to content

pytorch_stargan and Background_Matting training performance regression #2342

@mengfei25

Description

@mengfei25

🐛 Describe the bug

category name nightly/2.7.1 (higher nightly is better)
torchbench_bfloat16_training pytorch_stargan 0.756873
torchbench_amp_fp16_training pytorch_stargan 0.777728
torchbench_amp_bf16_training pytorch_stargan 0.786676
torchbench_bfloat16_training Background_Matting 0.788148
torchbench_float16_training Background_Matting 0.804781
torchbench_float16_training pytorch_stargan 0.789188
torchbench_amp_bf16_training Background_Matting 0.813375
torchbench_amp_fp16_training Background_Matting 0.809384

Reproducer

# Create python3 env
pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/xpu
# pip install torch==2.7.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/xpu

pytorch_commit="$(python -c 'import torch; print(torch.version.git_version)')"

git clone https://github.com/pytorch/pytorch
cd pytorch
git checkout ${pytorch_commit}
cd ..
git clone https://github.com/pytorch/benchmark
cd benchmark
pip install -r requirements.txt
python install.py pytorch_stargan # Background_Matting

cd ../pytorch
python benchmarks/dynamo/torchbench.py --performance --float16 -d xpu -n10 --training --only pytorch_stargan --cold-start-latency --backend=inductor

Versions

2.10.0.dev20251110+xpu compared with release 2.7.1

Metadata

Metadata

Assignees

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions