Projects
View on GitHub
linghu8812/tensorrt_inference
linghu8812/tensorrt_inference has 714 GitHub stars and 202 forks. GitHot measured 0 stars in 24 hours. Last checked 2026-11-15 18:45 UTC. Last push 2023-08-23.
Measured star growth
- in 24h
- 0
- in 7 days
- Update delayed
- in 15 days
- Update delayed
- in 1 month
- Update delayed
Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.
About
after these steps, the executable program tensorrt_inference and all support model shared libraries have been built.
Developer ToolsREADME.md
OriginalTensorRT Models Deploy from ONNX
Install Depends
see INSTALL.md
Build from Docker
docker build -t tensorrt_inference:0.1.0_rc .
How to Use
- Build tensorrt_inference project:
git clone https://github.com/linghu8812/tensorrt_inference.git
cd tensorrt_inference/project
mkdir build && cd build
cmake ..
make -j
after these steps, the executable program tensorrt_inference and all support model shared libraries have been built.
- Run tensorrt_inference
./tensorrt_inference
it will show:
Please design model arch, config file and folder name!
- Inference with models, take yolov5 model as example, put
yolov5s.onnxmodel intoweightsfolder:
cd ../../bin/
./tensorrt_inference yolov5 ../configs/yolov5/config.yaml ../samples/detection_segmentation
Use one model library example can reference here example
Supported Models
download transfered ONNX models, and put them into folder weights: https://pan.baidu.com/s/1Ff_SA9Q66DUnZjSipPa74Q, code: opkp

| models | framework | instruction |
|---|---|---|
| lenet | PyTorch | An example from model training to TensorRT model deploy |
| alexnet | MXNet Gluon | MXNet Gluon example |
| arcface | MXNet Symbol | MXNet Symbol and face recognition example |
| CenterFace | ONNX | rewrite ONNX model and face detection example |
| efficientnet | Keras | Keras to ONNX example |
| face_alignment | MXNet Symbol | MXNet Symbol and face key points detection example |
| fast-reid | PyTorch | PyTorch and pedestrian reid example |
| FCN | GluonCV | MXNet GluonCV semantic segmentation example |
| gender-age | MXNet Symbol | MXNet Symbol and face gender and age recognize example |
| ghostnet | PyTorch | PyTorch example |
| MiniFASNet | PyTorch | PyTorch face anti spoofing example |
| mmpose | PyTorch | PyTorch person key points detect example |
| nanodet | PyTorch | PyTorchlightweight anchor-free object detection example |
| RetinaFace | MXNet Symbol | MXNet Symbol and face detection example |
| ScaledYOLOv4 | PyTorch | YOLOv4 large with PyTorch implementation |
| scrfd | PyTorch | PyTorch scrfd face detection example |
| seresnext | PyTorch | PyTorch example |
| Swin-Transformer | timm | timm image classification example |
| yolor | PyTorch | PyTorch and object detection example |
| Yolov4 | darknet | darknet and object detection example |
| yolov5 | PyTorch | PyTorch and object detection example |
| YOLOv6 | PyTorch | PyTorch and object detection example |
| yolov7 | PyTorch | PyTorch and object detection example |
| yolov8 | ultralytics | ultralytics object detection example |
Discussion Groups
- QQ group: 588966055