Skip to content
Projects

linghu8812/tensorrt_inference

View on GitHub

linghu8812/tensorrt_inference has 714 GitHub stars and 202 forks. GitHot measured 0 stars in 24 hours. Last checked 2026-11-15 18:45 UTC. Last push 2023-08-23.

How these counts are measured

Measured star growth

in 24h
0
in 7 days
Update delayed
in 15 days
Update delayed
in 1 month
Update delayed

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

About

after these steps, the executable program tensorrt_inference and all support model shared libraries have been built.

Developer Tools

README.md

Original

TensorRT Models Deploy from ONNX

OSCS Status

Install Depends

see INSTALL.md

Build from Docker

docker build -t tensorrt_inference:0.1.0_rc .

How to Use

  • Build tensorrt_inference project:
git clone https://github.com/linghu8812/tensorrt_inference.git
cd tensorrt_inference/project
mkdir build && cd build
cmake ..
make -j

after these steps, the executable program tensorrt_inference and all support model shared libraries have been built.

  • Run tensorrt_inference
./tensorrt_inference

it will show:

Please design model arch, config file and folder name!
  • Inference with models, take yolov5 model as example, put yolov5s.onnx model into weights folder:
cd ../../bin/
./tensorrt_inference yolov5 ../configs/yolov5/config.yaml ../samples/detection_segmentation

Use one model library example can reference here example

Supported Models

download transfered ONNX models, and put them into folder weights: https://pan.baidu.com/s/1Ff_SA9Q66DUnZjSipPa74Q, code: opkp

models framework instruction
lenet PyTorch An example from model training to TensorRT model deploy
alexnet MXNet Gluon MXNet Gluon example
arcface MXNet Symbol MXNet Symbol and face recognition example
CenterFace ONNX rewrite ONNX model and face detection example
efficientnet Keras Keras to ONNX example
face_alignment MXNet Symbol MXNet Symbol and face key points detection example
fast-reid PyTorch PyTorch and pedestrian reid example
FCN GluonCV MXNet GluonCV semantic segmentation example
gender-age MXNet Symbol MXNet Symbol and face gender and age recognize example
ghostnet PyTorch PyTorch example
MiniFASNet PyTorch PyTorch face anti spoofing example
mmpose PyTorch PyTorch person key points detect example
nanodet PyTorch PyTorchlightweight anchor-free object detection example
RetinaFace MXNet Symbol MXNet Symbol and face detection example
ScaledYOLOv4 PyTorch YOLOv4 large with PyTorch implementation
scrfd PyTorch PyTorch scrfd face detection example
seresnext PyTorch PyTorch example
Swin-Transformer timm timm image classification example
yolor PyTorch PyTorch and object detection example
Yolov4 darknet darknet and object detection example
yolov5 PyTorch PyTorch and object detection example
YOLOv6 PyTorch PyTorch and object detection example
yolov7 PyTorch PyTorch and object detection example
yolov8 ultralytics ultralytics object detection example

Discussion Groups

  • QQ group: 588966055