4 ms·
I used a small (3b, I think) model plus tesseract.js to perform OCR on an image of a nutritional facts table and output structured JSON.
by JLCarveth 2y ago
I used a small (3b, I think) model plus tesseract.js to perform OCR on an image of a nutritional facts table and output structured JSON.
- deivid 2y agoWhat was the model? What kind of performance did you get out of it? Could you share a link to your project, if it is public?
- JLCarveth 2y agohttps://github.com/JLCarveth/nutrition-llama https://github.com/JLCarveth/nutrition-llama I've had good speed / reliability with TheBloke/rocket-3B-GGUF on Huggingface, the Q2_K model. I'm sure there are better models out there now, though. It takes ~8-10 seconds to process an image on my M2 Macbook, so not quite quick enough to run on phones yet, but the accuracy of the output has been quite good.
- tigrank 2y agoAll that server side or client?
- ian_zcy 2y agowhat are you feed into the model? Image (like product packaging) or Image of Structured Table? I found out that model performs good in general with sturctured table, but fails a lot over images.