3 ms·
Am I crazy or has text parsing been mastered long before AI. Why is GPT being used in this scenario in the first place ?
by bilekas 1y ago
Am I crazy or has text parsing been mastered long before AI. Why is GPT being used in this scenario in the first place ?
- hansonkd 1y agoIt seems like a default mode for AI should be to generate repeatable Regex for text extraction.
- tdeck 1y agoUnfortunately many PDFs don't even internally represent text in a contiguous way.
- tdeck 1y agoBecause it's less effort to get an MVP set up. Instead of having to test on a bunch of different PDFs and figure out how to address the right location in the text, just write a paragraph asking the LLM to do it. Of course, there are certain drawbacks...
- mattnewton 1y agoBecause it’s easier than asking for a consistently formatted data from all the sources who just output random PDFs. Basically this is a coordination / people problem we’re papering over with a fancy engineering solution. Many such cases.
- deleted 1y ago[deleted]
- hluska 1y agoNot in PDF.
- bilekas 1y agoNo, not in the PDF spec, but are we allowed process images of every page, text adaption, etc. Where does GPT come in ?
- fragmede 1y agoTables in PDFs still confuse traditional OCR engines. VLMs do better in some cases (though not this one, apparently).