3 ms·
Good: - no cloud service required, can run on local Nvidia GPU - outputs a single stream of text with the correct reading order (even for multi column PDF) -
by rahimnathwani 2y ago
Good:
- no cloud service required, can run on local Nvidia GPU
- outputs a single stream of text with the correct reading order (even for multi column PDF)
- recognizes handwriting and stuff
Bad:
- doesn't seem to extract the text within diagrams (which I guess is fine because that text would be useless to an LLM)
OP is the demo page, which lets you OCR 10 pages.
The code needs an Nvidia GPU to run: https://github.com/allenai/olmocr https://github.com/allenai/olmocr
Not sure if the VRAM requirements because I haven't tried running locally yet.
- thelittleone 2y agoText from diagrams can be useful in LLMs. For example an LLM can understand a flow charts decision making shapes etc, but without text it could misinterpret information. I process a bunch of PDFs including procedures. Diagrams are concerted to code. The text helps in many cases.
- rahimnathwani 2y agoDiagrams are concerted to code That's cool. May I ask what your pipeline looks like? And what code format do you use for diagrams? Mermaid?