Issues

• Adding vendor RBLN(Rebellions)

  pytorch/serve#3416 · Filter by author rebel-ysseo opened on May 8, 2025

• Why Use TorchScript Format Models?

  pytorch/serve#3409 · Filter by author CongSuxu opened on Apr 3, 2025

• deploy modernBERT model question

  pytorch/serve#3404 · Filter by author geraldstanje opened on Mar 22, 2025

• Why is TorchServe No Longer Actively Maintained?

  pytorch/serve#3396 · Filter by author ily666666 opened on Mar 3, 2025
  11

• Rename open_inference_grpc.proto package name

  pytorch/serve#3394 · Filter by author jwang20250226 opened on Feb 26, 2025

• map workers and GPUs, deviceIds not considered in ts_config

  pytorch/serve#3393 · Filter by author RuDevKu opened on Feb 25, 2025

• How can a user specify an envelope?

  pytorch/serve#3391 · Filter by author yurkoff-mv opened on Feb 14, 2025

• Reference to Nvidia MPS in README.md references a non-existent file

  pytorch/serve#3389 · Filter by author cipherself opened on Feb 13, 2025

• please add java api cli to generate model archiver mar file or tell the generate logic

  pytorch/serve#3386 · Filter by author mullerhai opened on Feb 9, 2025

• ROCm support missing from Dockerfile

  module: rocm
  pytorch/serve#3380 · Filter by author jakki-amd opened on Jan 7, 2025

• Torchserve-kfs docker images for other python version (3.10+)

  pytorch/serve#3374 · Filter by author cjidboon94 opened on Dec 12, 2024
  3

• vLLM ZeroDivisionError

  pytorch/serve#3373 · Filter by author mfahadyousaf opened on Dec 10, 2024

• Unable to build frontend after following the documentation

  pytorch/serve#3364 · Filter by author mihaidusmanu opened on Nov 11, 2024

• Trying to find a doc explaining how the scaling works (min_worker to max_worker)

  pytorch/serve#3362 · Filter by author lschaupp opened on Nov 9, 2024

• Issue when sending parallel requests

  pytorch/serve#3361 · Filter by author lschaupp opened on Nov 8, 2024
  1

• weights_only default flip for torch.load

  pytorch/serve#3360 · Filter by author mikaylagawarecki opened on Nov 7, 2024

• Low Throughput and High Latency with TorchServe Deployment on AWS

  pytorch/serve#3359 · Filter by author dummyuser-123 opened on Nov 6, 2024

• Model & Instance scaling

  pytorch/serve#3358 · Filter by author markcNewell opened on Nov 5, 2024

• 413 Request Entity Too Large

  pytorch/serve#3357 · Filter by author pengxin233 opened on Nov 5, 2024
  1

• Allow to provide custom model_service_worker.py

  pytorch/serve#3353 · Filter by author racinmat opened on Oct 23, 2024

• Make TorchServe usable without torch installed

  pytorch/serve#3350 · Filter by author racinmat opened on Oct 21, 2024

• Error in MetricCollector when starting pytorch/torchserve:0.12.0-gpu container

  pytorch/serve#3349 · Filter by author Hspix opened on Oct 19, 2024

• Getting started guide client samples broken ?

  pytorch/serve#3348 · Filter by author nikste opened on Oct 15, 2024
  1

• Add Detectron2 Support to TorchServe Object Detection Examples

  pytorch/serve#3344 · Filter by author Mudassar-MLE opened on Oct 9, 2024
  3

  

• Clarification on minWorkers and maxWorkers parameters

  pytorch/serve#3339 · Filter by author krzwaraksa opened on Oct 3, 2024