3 ms·
Someone posted a project here about a month ago where they compare models in head-to-head matchups similar to llmarena https://www.ocrarena.ai/leaderboard http
by culi 11mo ago
Someone posted a project here about a month ago where they compare models in head-to-head matchups similar to llmarena
https://www.ocrarena.ai/leaderboard https://www.ocrarena.ai/leaderboard
Hasn't been updated for Mistral but so far gemeni seems to top the leaderboard.
- jeffbee 11mo agoOCR developers from decades past must be slapping their foreheads now that it seems users will wait a whole minute per page and be happy.
- delaminator 11mo agoWhat they are happy about is accurate OCR. Getting the wrong answer really quickly is not the best goal.
- culi 11mo agoYou can also sort by latency. dots.ocr has the lowest at 3.8s/page. And although it doesn't fare very well against much larger slower models, it's still streets ahead of traditional OCR techniques
- andai 11mo agoHow can something have a very high ELO but a very low win rate?
- BlackLotus89 11mo agoYou don't loose any elo if your opponent is much stronger than you. Remis could in theory play a part as well.
- pplonski86 11mo agovery nice comparison! I'd like to see on what examples OCR engines fail