Recompile time is under a second for most models that I tried. Let's say 150 - 700 ms. Once you compile it, you can use it many times. The diference for the in

Recompile time is under a second for most models that I tried. Let's say 150 - 700 ms. Once you compile it, you can use it many times. The diference for the inference time is in the post below (but YMMV).