3 ms·
It has to get the image data first, basically just IO time before processing it
by weird-eye-issue 1y ago
It has to get the image data first, basically just IO time before processing it
- ashed96 1y agoIIRC there's pre-processing (embedding/tokenization?) before feeding images to LLMs? Hit this issue optimizing LLM request times. Ending up lowering image resolution. Lost some accuracy but could bear that.