NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
-
Updated
Dec 13, 2024 - C++
#
tensorrt
Here are 718 public repositories matching this topic...
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
-
Updated
Nov 20, 2024 - Python
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
machine-learning embedded caffe computer-vision deep-learning robotics inference nvidia digits image-recognition segmentation object-detection jetson-tx1 jetson tensorrt jetson-tx2 video-analytics jetson-xavier jetson-nano jetson-xavier-nx
-
Updated
Oct 16, 2024 - C++
Implementation of popular deep learning networks with TensorRT network definition API
resnet squeezenet tensorrt crnn arcface mobilenetv2 yolov3 mnasnet retinaface mobilenetv3 yolov3-spp yolov4 yolov5 detr swin-transformer yolov7 yolov8 yolov9 yolo11
-
Updated
Dec 6, 2024 - C++
BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models
deep-learning yolo segmentation multi-object-tracking mot tensorrt tracking-by-detection mots osnet multi-object-tracking-segmentation bytetrack strongsort ocsort botsort deepocsort improvedassociation
-
Updated
Dec 29, 2024 - Python
Tengine is a lite, high performance, modular inference engine for embedded device
machine-learning arm mips tensorflow x86-64 container cuda acl cnn pytorch artificial-intelligence riscv tensorrt onnx nvdla npu supperedge
-
Updated
Sep 15, 2024 - C++
An easy to use PyTorch to TensorRT converter
-
Updated
Aug 17, 2024 - Python
PyTorch ,ONNX and TensorRT implementation of YOLOv4
-
Updated
Jun 19, 2024 - Python
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …
ocr deep-learning tensorflow inference pytorch tengine face-detection tensorrt mnn coreml ncnn openvino hairsegmentaion
-
Updated
Dec 19, 2024 - C++
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
-
Updated
May 25, 2024 - Python
🛠 A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. 🎉🎉
tensorrt mnn ncnn onnx ncnn-model onnxruntime yolov5 tnn tensorrt-inference mnn-model yolox robustvideomatting onnxruntime-gpu yolov6 yolov8
-
Updated
Dec 26, 2024 - C++
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
detection transformers face yolo object-detection tensorrt instance-segmentation onnx detr yolox yolov6 detextron2 yolov7
-
Updated
Nov 18, 2023 - Python
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
android intel rockchip object-detection jetson tensorrt serving onnx openvino onnxruntime graphcore yolov5 kunlun uie picodet stable-diffusion yolov8
-
Updated
Nov 21, 2024 - C++
OpenMMLab Model Deployment Framework
sdk computer-vision deep-learning deployment pytorch tensorrt ncnn onnx model-converter openvino mmdetection onnxruntime mmsegmentation pplnn
-
Updated
Sep 30, 2024 - Python
《Pytorch实用教程》（第二版）无论是零基础入门，还是CV、NLP、LLM项目应用，或是进阶工程化部署落地，在这里都有。相信在本书的帮助下，读者将能够轻松掌握 PyTorch 的使用，成为一名优秀的深度学习工程师。
-
Updated
Nov 8, 2024 - Jupyter Notebook
C++ library based on tensorrt integration
-
Updated
May 24, 2023 - C++
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
-
Updated
Dec 30, 2024 - Python
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
microservice gpu-acceleration nemo tensorrt rag triton-inference-server large-language-models llm llm-inference retrieval-augmented-generation
-
Updated
Dec 23, 2024 - Python
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
machine-learning caffe deep-learning time-series gpu rest-api pytorch xgboost image-classification image-search object-detection image-segmentation tsne neural-nets tensorrt ncnn tensorrt-conversion tensorrt-inference
-
Updated
Nov 22, 2024 - C++
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
pytorch transformer android-app tensorrt mnn mobilenet ncnn tflite shufflenetv2 onnxruntime yolov5 repvgg pplcnet openvivo picodet
-
Updated
Jun 22, 2024 - C++
Improve this page
Add a description, image, and links to the tensorrt topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tensorrt topic, visit your repo's landing page and select "manage topics."