Search results

Lluo/lan fix torch compile gpt2

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: coreIssues re: The core compilerIssues re: The core compiler

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: runtime

WIPWork is in progress, pull request should not be merged yetWork is in progress, pull request should not be merged yet

Status: Draft (not ready).

pytorch/TensorRTnumber 3671

#3671 In pytorch/TensorRT;

· lanluo-nvidia opened on Jul 8, 2025

chore: cherry pick of KV cache PR (3527)

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: runtime

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open (in progress).

pytorch/TensorRTnumber 3667

#3667 In pytorch/TensorRT;

· peri044 opened on Jul 8, 2025

chore: cherry pick of bf16 cast PR (3643)

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: convertersIssues re: Specific op convertersIssues re: Specific op converters

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: testsIssues re: TestsIssues re: Tests

Status: Open (in progress).

pytorch/TensorRTnumber 3666

#3666 In pytorch/TensorRT;

· peri044 opened on Jul 7, 2025

cherry pick 3663: fix the int8 quantization error, remove duplicated lines

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: convertersIssues re: Specific op convertersIssues re: Specific op converters

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

Status: Open (in progress).

pytorch/TensorRTnumber 3665

#3665 In pytorch/TensorRT;

· lanluo-nvidia opened on Jul 7, 2025

Cherrypick of PR 3513

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: loweringIssues re: The lowering / preprocessing passesIssues re: The lowering / preprocessing passes

component: testsIssues re: TestsIssues re: Tests

Status: Open (in progress).

pytorch/TensorRTnumber 3664

#3664 In pytorch/TensorRT;

· apbose opened on Jul 7, 2025

fix the int8 quantization failure error

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: convertersIssues re: Specific op convertersIssues re: Specific op converters

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

Status: Open (in progress).

pytorch/TensorRTnumber 3663

#3663 In pytorch/TensorRT;

· lanluo-nvidia opened on Jul 7, 2025

Cherrypick of PR 3570

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: loweringIssues re: The lowering / preprocessing passesIssues re: The lowering / preprocessing passes

component: testsIssues re: TestsIssues re: Tests

Status: Open (in progress).

pytorch/TensorRTnumber 3662

#3662 In pytorch/TensorRT;

· apbose opened on Jul 7, 2025

Add Flux fp4 support

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: loweringIssues re: The lowering / preprocessing passesIssues re: The lowering / preprocessing passes

component: runtime

Status: Open (in progress).

pytorch/TensorRTnumber 3657

#3657 In pytorch/TensorRT;

· lanluo-nvidia opened on Jul 4, 2025

Upgrade perf_run script to support TRT 10 and fix some issues

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: loweringIssues re: The lowering / preprocessing passesIssues re: The lowering / preprocessing passes

Status: Open (in progress).

pytorch/TensorRTnumber 3650

#3650 In pytorch/TensorRT;

· zewenli98 opened on Jul 2, 2025

Cpu memory optimization

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: loweringIssues re: The lowering / preprocessing passesIssues re: The lowering / preprocessing passes

Status: Draft (not ready).

pytorch/TensorRTnumber 3602

#3602 In pytorch/TensorRT;

· cehongwang opened on Jun 17, 2025

TRT-LLM loading mechanism tool

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: build systemIssues re: Build systemIssues re: Build system

component: conversionIssues re: Conversion stageIssues re: Conversion stage

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: testsIssues re: TestsIssues re: Tests

Status: Open (in progress).

pytorch/TensorRTnumber 3398

#3398 In pytorch/TensorRT;

· apbose opened on Feb 14, 2025

Enabled python runtime saving

cla signed

component: api [Python]Issues re: Python APIIssues re: Python API

component: dynamoIssues relating to the `torch.compile` or `torch._dynamo.export` pathsIssues relating to the `torch.compile` or `torch._dynamo.export` paths

component: runtime

Status: Open (in progress).

pytorch/TensorRTnumber 2999

#2999 In pytorch/TensorRT;

· cehongwang opened on Jul 11, 2024