Skip to content

Commit 26dfb20

Browse files
authored
Update server.py No need to disable cudagraphs
1 parent 3b02ebf commit 26dfb20

File tree

1 file changed

+0
-5
lines changed

1 file changed

+0
-5
lines changed

moshi/moshi/server.py

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -28,11 +28,6 @@
2828
import torch._dynamo
2929
torch._dynamo.config.suppress_errors = True
3030

31-
# Disable CUDA graph capture
32-
# This is needed because quantized models may use operations
33-
# that aren't compatible with CUDA graph capture
34-
os.environ["NO_CUDA_GRAPH"] = "1"
35-
3631
from .client_utils import log
3732
from .models import loaders, MimiModel, LMModel, LMGen
3833
from .run_inference import get_condition_tensors

0 commit comments

Comments
 (0)