Skip to content

Commit 57014b2

Browse files
authored
Merge pull request #12 from leimao/trtexec
Add trtexec build command
2 parents 912e599 + 961d6ad commit 57014b2

1 file changed

Lines changed: 17 additions & 1 deletion

File tree

README.md

Lines changed: 17 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ $ docker build -f docker/tensorrt.Dockerfile --no-cache --tag=tensorrt:24.05 .
2121
To run the custom Docker container, please run the following command.
2222

2323
```bash
24-
$ docker run -it --rm --gpus device=0 -v $(pwd):/mnt tensorrt:24.05
24+
$ docker run -it --rm --gpus device=0 -v $(pwd):/mnt -w /mnt tensorrt:24.05
2525
```
2626

2727
### Build Application
@@ -71,16 +71,32 @@ To build the TensorRT engine from the ONNX model, please run the following comma
7171

7272
#### Build Engine with IPluginV2IOExt
7373

74+
We could build TensorRT engine using the builder application.
75+
7476
```bash
7577
$ ./build/src/apps/build_engine data/identity_neural_network.onnx build/src/plugins/IdentityConvIPluginV2IOExt/libidentity_conv_iplugin_v2_io_ext.so data/identity_neural_network_iplugin_v2_io_ext.engine
7678
```
7779

80+
Alternatively, we could use `trtexec` to build the TensorRT engine.
81+
82+
```bash
83+
$ trtexec --onnx=data/identity_neural_network.onnx --saveEngine=data/identity_neural_network_iplugin_v2_io_ext.engine --staticPlugins=build/src/plugins/IdentityConvIPluginV2IOExt/libidentity_conv_iplugin_v2_io_ext.so
84+
```
85+
7886
#### Build Engine with IPluginV3
7987

88+
We could build TensorRT engine using the builder application.
89+
8090
```bash
8191
$ ./build/src/apps/build_engine data/identity_neural_network.onnx build/src/plugins/IdentityConvIPluginV3/libidentity_conv_iplugin_v3.so data/identity_neural_network_iplugin_v3.engine
8292
```
8393

94+
Alternatively, we could use `trtexec` to build the TensorRT engine.
95+
96+
```bash
97+
$ trtexec --onnx=data/identity_neural_network.onnx --saveEngine=data/identity_neural_network_iplugin_v3.engine --staticPlugins=build/src/plugins/IdentityConvIPluginV3/libidentity_conv_iplugin_v3.so
98+
```
99+
84100
### Run TensorRT Engine
85101

86102
To run the TensorRT engine, please run the following command.

0 commit comments

Comments
 (0)