Update - After some code optimization, I got the inference time down to below 100ms. The lowest I got on my Pixel 3 XL is 37ms! https://dicksonneoh.com/portfol

Update - After some code optimization, I got the inference time down to below 100ms. The lowest I got on my Pixel 3 XL is 37ms! https://dicksonneoh.com/portfolio/pytorch_at_the_edge_timm_torchscript_flutter/vids/inference_edgenext.mp4 https://dicksonneoh.com/portfolio/pytorch_at_the_edge_timm_t...