3 ms·
Is it possible to do this locally with open source software? I have a lot of accounting PDFs to convert but due to privacy concerns it should not run in the clo
by alecco 2y ago
Is it possible to do this locally with open source software? I have a lot of accounting PDFs to convert but due to privacy concerns it should not run in the cloud.
- criddell 2y agoDoes it have to be open source, or just running locally? The paid version of Acrobat does this well. MacOS has pretty good built-in OCR capabilities and Windows isn’t far behind. If you have the hardware for it, you can run some LLMs locally. Although for accounting data, I probably wouldn’t trust it.
- cess11 2y agoEither you need to be somewhat tolerant when it comes to misinterpretations and hallucinations, or you'll be proofreading a lot. A cheap hack is to push the documents through pdftotext from Poppler and if nothing or very little comes out, push them through OCRMyPDF and pipe it to pdftotext. If it's scanned you probably want some flags for deskewing and so on. To make a bulk load of PDF mostly greppable it's a decent technique, to get every 0 as a 0 you're probably going to proofread every conversion.
- Eisenstein 2y agoI don't recommend using it for anything important unless you very diligently proofread it, but I made one that runs locally that I linked to elsewhere in this post: * https://news.ycombinator.com/item?id=42155548 https://news.ycombinator.com/item?id=42155548
- bugglebeetle 2y agoYes, Docling and Marker do very similar things and can be run fully locally.