Repositories list

• TensorRT-LLM

  Public
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inferen…

  Python

  •

  Other

  •2.9k2.9k forks in triton-inference-server/TensorRT-LLM•77 stars in triton-inference-server/TensorRT-LLM•00 issues in triton-inference-server/TensorRT-LLM•00 pull requests in triton-inference-server/TensorRT-LLM•Updated Oct 26, 2026Oct 26, 2026

• server

  Public
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  machine-learningclouddeep-learning+ 4

  machine-learningclouddeep-learninggpuinferenceedgedatacenter

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1.9k1.9k forks in triton-inference-server/server•11k11k stars in triton-inference-server/server•779779 issues in triton-inference-server/server•124124 pull requests in triton-inference-server/server•Updated Oct 26, 2026Oct 26, 2026

• model_analyzer

  Public
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

  deep-learninggpuinference+ 1

  deep-learninggpuinferenceperformance-analysis

  Python

  •

  Apache License 2.0

  •9595 forks in triton-inference-server/model_analyzer•530530 stars in triton-inference-server/model_analyzer•33 issues in triton-inference-server/model_analyzer•11 pull request in triton-inference-server/model_analyzer•Updated Oct 23, 2026Oct 23, 2026

• tensorrt_backend

  Public
  The Triton backend for TensorRT.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •4343 forks in triton-inference-server/tensorrt_backend•9696 stars in triton-inference-server/tensorrt_backend•00 issues in triton-inference-server/tensorrt_backend•22 pull requests in triton-inference-server/tensorrt_backend•Updated Oct 23, 2026Oct 23, 2026

• core

  Public
  The core library and APIs implementing the Triton Inference Server.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •152152 forks in triton-inference-server/core•184184 stars in triton-inference-server/core•00 issues in triton-inference-server/core•3939 pull requests in triton-inference-server/core•Updated Oct 22, 2026Oct 22, 2026

• pytorch_backend

  Public
  The Triton backend for the PyTorch TorchScript models.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •8080 forks in triton-inference-server/pytorch_backend•184184 stars in triton-inference-server/pytorch_backend•00 issues in triton-inference-server/pytorch_backend•77 pull requests in triton-inference-server/pytorch_backend•Updated Oct 22, 2026Oct 22, 2026

• tutorials

  Public
  This repository contains tutorials and examples for Triton Inference Server

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •159159 forks in triton-inference-server/tutorials•870870 stars in triton-inference-server/tutorials•88 issues in triton-inference-server/tutorials•2121 pull requests in triton-inference-server/tutorials•Updated Oct 21, 2026Oct 21, 2026

• client

  Public
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •261261 forks in triton-inference-server/client•702702 stars in triton-inference-server/client•6262 issues in triton-inference-server/client•3434 pull requests in triton-inference-server/client•Updated Oct 21, 2026Oct 21, 2026

• python_backend

  Public
  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •207207 forks in triton-inference-server/python_backend•682682 stars in triton-inference-server/python_backend•00 issues in triton-inference-server/python_backend•2525 pull requests in triton-inference-server/python_backend•Updated Oct 21, 2026Oct 21, 2026

• perf_analyzer

  Public
  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •5353 forks in triton-inference-server/perf_analyzer•164164 stars in triton-inference-server/perf_analyzer•3434 issues in triton-inference-server/perf_analyzer•1919 pull requests in triton-inference-server/perf_analyzer•Updated Oct 19, 2026Oct 19, 2026

• common

  Public
  Common source, scripts and utilities shared across all Triton repositories.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •8181 forks in triton-inference-server/common•8181 stars in triton-inference-server/common•00 issues in triton-inference-server/common•1111 pull requests in triton-inference-server/common•Updated Oct 15, 2026Oct 15, 2026

• dali_backend

  Public
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.

  pythondeep-learninggpu+ 5

  pythondeep-learninggpuimage-processingdalidata-preprocessingnvidia-dalifast-data-pipeline

  C++

  •

  MIT License

  •3939 forks in triton-inference-server/dali_backend•148148 stars in triton-inference-server/dali_backend•2121 issues in triton-inference-server/dali_backend•00 pull requests in triton-inference-server/dali_backend•Updated Oct 15, 2026Oct 15, 2026

• third_party

  Public
  Third-party source packages that are modified for use in Triton.

  C

  •

  BSD 3-Clause "New" or "Revised" License

  •6767 forks in triton-inference-server/third_party•66 stars in triton-inference-server/third_party•00 issues in triton-inference-server/third_party•55 pull requests in triton-inference-server/third_party•Updated Oct 14, 2026Oct 14, 2026

• vllm_backend

  Public
  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •5656 forks in triton-inference-server/vllm_backend•364364 stars in triton-inference-server/vllm_backend•00 issues in triton-inference-server/vllm_backend•1111 pull requests in triton-inference-server/vllm_backend•Updated Oct 10, 2026Oct 10, 2026

• fil_backend

  Public
  FIL backend for the Triton Inference Server

  C++

  •

  Apache License 2.0

  •4242 forks in triton-inference-server/fil_backend•9494 stars in triton-inference-server/fil_backend•5454 issues in triton-inference-server/fil_backend•00 pull requests in triton-inference-server/fil_backend•Updated Oct 9, 2026Oct 9, 2026

• tensorrtllm_backend

  Public
  The Triton TensorRT-LLM Backend

  Apache License 2.0

  •146146 forks in triton-inference-server/tensorrtllm_backend•945945 stars in triton-inference-server/tensorrtllm_backend•320320 issues in triton-inference-server/tensorrtllm_backend•2424 pull requests in triton-inference-server/tensorrtllm_backend•Updated Oct 8, 2026Oct 8, 2026

• triton_cli

  Public
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.

  Python

  •88 forks in triton-inference-server/triton_cli•7373 stars in triton-inference-server/triton_cli•44 issues in triton-inference-server/triton_cli•33 pull requests in triton-inference-server/triton_cli•Updated Oct 8, 2026Oct 8, 2026

• square_backend

  Public
  Simple Triton backend used for testing.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •88 forks in triton-inference-server/square_backend•33 stars in triton-inference-server/square_backend•00 issues in triton-inference-server/square_backend•00 pull requests in triton-inference-server/square_backend•Updated Oct 8, 2026Oct 8, 2026

• repeat_backend

  Public
  An example Triton backend that demonstrates sending zero, one, or multiple responses for each request.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •1111 forks in triton-inference-server/repeat_backend•77 stars in triton-inference-server/repeat_backend•00 issues in triton-inference-server/repeat_backend•00 pull requests in triton-inference-server/repeat_backend•Updated Oct 8, 2026Oct 8, 2026

• redis_cache

  Public
  TRITONCACHE implementation of a Redis cache

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •88 forks in triton-inference-server/redis_cache•1818 stars in triton-inference-server/redis_cache•33 issues in triton-inference-server/redis_cache•00 pull requests in triton-inference-server/redis_cache•Updated Oct 8, 2026Oct 8, 2026

• openvino_backend

  Public
  OpenVINO backend for Triton.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •2323 forks in triton-inference-server/openvino_backend•3939 stars in triton-inference-server/openvino_backend•66 issues in triton-inference-server/openvino_backend•11 pull request in triton-inference-server/openvino_backend•Updated Oct 8, 2026Oct 8, 2026

• onnxruntime_backend

  Public
  The Triton backend for the ONNX Runtime.

  backendinferencetriton-inference-server+ 1

  backendinferencetriton-inference-serveronnx-runtime

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •8787 forks in triton-inference-server/onnxruntime_backend•187187 stars in triton-inference-server/onnxruntime_backend•7373 issues in triton-inference-server/onnxruntime_backend•1010 pull requests in triton-inference-server/onnxruntime_backend•Updated Oct 8, 2026Oct 8, 2026

• local_cache

  Public
  Implementation of a local in-memory cache for Triton Inference Server's TRITONCACHE API

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •66 forks in triton-inference-server/local_cache•66 stars in triton-inference-server/local_cache•11 issue in triton-inference-server/local_cache•00 pull requests in triton-inference-server/local_cache•Updated Oct 8, 2026Oct 8, 2026

• identity_backend

  Public
  Example Triton backend that demonstrates most of the Triton Backend API.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •1717 forks in triton-inference-server/identity_backend•66 stars in triton-inference-server/identity_backend•00 issues in triton-inference-server/identity_backend•00 pull requests in triton-inference-server/identity_backend•Updated Oct 8, 2026Oct 8, 2026

• checksum_repository_agent

  Public
  The Triton repository agent that verifies model checksums.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •1212 forks in triton-inference-server/checksum_repository_agent•1414 stars in triton-inference-server/checksum_repository_agent•00 issues in triton-inference-server/checksum_repository_agent•00 pull requests in triton-inference-server/checksum_repository_agent•Updated Oct 8, 2026Oct 8, 2026

• backend

  Public
  Common source, scripts and utilities for creating Triton backends.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •113113 forks in triton-inference-server/backend•381381 stars in triton-inference-server/backend•00 issues in triton-inference-server/backend•66 pull requests in triton-inference-server/backend•Updated Oct 8, 2026Oct 8, 2026

• developer_tools

  Public
  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •1414 forks in triton-inference-server/developer_tools•2222 stars in triton-inference-server/developer_tools•00 issues in triton-inference-server/developer_tools•44 pull requests in triton-inference-server/developer_tools•Updated Oct 6, 2026Oct 6, 2026

• .github

  Public
  Community health files for NVIDIA Triton

  22 forks in triton-inference-server/.github•22 stars in triton-inference-server/.github•00 issues in triton-inference-server/.github•00 pull requests in triton-inference-server/.github•Updated Jul 22, 2026Jul 22, 2026

• model_navigator

  Public
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.

  deep-learninggpuinference

  deep-learninggpuinference

  Python

  •

  Apache License 2.0

  •3232 forks in triton-inference-server/model_navigator•226226 stars in triton-inference-server/model_navigator•44 issues in triton-inference-server/model_navigator•00 pull requests in triton-inference-server/model_navigator•Updated May 27, 2026May 27, 2026

• tensorflow_backend

  Public
  The Triton backend for TensorFlow.

  C++

  •

  BSD 3-Clause "New" or "Revised" License

  •2929 forks in triton-inference-server/tensorflow_backend•5757 stars in triton-inference-server/tensorflow_backend•00 issues in triton-inference-server/tensorflow_backend•22 pull requests in triton-inference-server/tensorflow_backend•Updated Nov 22, 2025Nov 22, 2025