3 ms·
> even though what TRT does is conceptually awesome from a deployment standpoint I thought the same until, earlier this week, I realized that if I convert a mo
by codethief 6y ago
> even though what TRT does is conceptually awesome from a deployment standpoint
I thought the same until, earlier this week, I realized that if I convert a model to TensorRT and serialize it & store it in a file that file is specific to my device (i.e. my specific Jetson Nano), meaning that my colleagues can't run that file on their Jetson Nano. What the actual fuck.
Do you happen to have found a workaround for this? I really don't want to have to convert the model anew every single time I deploy it. There are just too many moving parts involved in the conversion process, dependency-wise.