You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+11-6Lines changed: 11 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,15 +1,21 @@
1
1
# TensorRTx
2
2
3
-
TensorRTx aims to implement popular deep learning networks with tensorrt network definition APIs. As we know, tensorrt has builtin parsers, including caffeparser, uffparser, onnxparser, etc. But when we use these parsers, we often run into some "unsupported operations or layers" problems, especially some state-of-the-art models are using new type of layers.
3
+
TensorRTx aims to implement popular deep learning networks with TensorRT network definition API.
4
4
5
-
So why don't we just skip all parsers? Instead, build the entire network directly using the tensorrt network definition API, which is not that complicated.
5
+
Why don't we use a parser (ONNX parser, UFF parser, caffe parser, etc), but use complex APIs to build a network from scratch? I have summarized the advantages in the following aspects.
6
+
-**Flexible**, easy to modify the network, add/delete a layer or input/output tensor, replace a layer, merge layers, integrate preprocessing and postprocessing into network, etc.
7
+
-**Debuggable**, construct the entire network in an incremental development manner, easy to get middle layer results.
8
+
-**Chance to learn**, learn about the network structure during this development, rather than treating everything as a black box.
6
9
7
-
I wrote this project to get familiar with tensorrt API, and also to share and learn from the community.
8
-
9
-
Get the trained models from pytorch, mxnet or tensorflow, etc. Export the weights to [.wts file](./tutorials/getting_started.md#the-wts-content-format). Then load weights in tensorrt, define network and do inference. Some pytorch models can be found in my repo [pytorchx](https://github.com/wang-xinyu/pytorchx), the remaining are from popular open-source repo.
10
+
The basic workflow of TensorRTx is:
11
+
1. Get the trained models from pytorch, mxnet or tensorflow, etc. Some pytorch models can be found in my repo [pytorchx](https://github.com/wang-xinyu/pytorchx), the remaining are from popular open-source repos.
12
+
2. Export the weights to a plain text file -- [.wts file](./tutorials/getting_started.md#the-wts-content-format).
13
+
3. Load weights in TensorRT, define the network, build a TensorRT engine.
14
+
4. Load the TensorRT engine and run inference.
10
15
11
16
## News
12
17
18
+
-`12 Dec 2022`. [East-Face](https://github.com/East-Face): [UNet](./unet) upgrade to support v3.0 of [Pytorch-UNet](https://github.com/milesial/Pytorch-UNet).
13
19
-`26 Oct 2022`. [ausk](https://github.com/ausk): YoloP(You Only Look Once for Panopitic Driving Perception).
14
20
-`19 Sep 2022`. [QIANXUNZDL123](https://github.com/QIANXUNZDL123) and [lindsayshuo](https://github.com/lindsayshuo): YOLOv7.
0 commit comments