the tensorrt is slow than pytorch #4
Description
Thank you for this wonderful project.
But I met a problem in python api of tensorrt to inference the model which is trained on pytorch.
I found the speed is slower in tensorrt than pytorch.
Like this project, I have 7226 classes of char, so the speed is 2.9ms/pic (32*100) in tensorrt (if dynamic input, the speed is 9ms/pic) . But when I test the same picture in pytorch(pytorch is dynamic input), it show only 3ms/pic.
Have you test the speed in pytorch?