3 ms·
I have a very similar project where I’ve extracted text and tables from over 1mm PDF filings in large bankruptcy cases - bankrupt11.com I still haven’t found a
by iav 6y ago
I have a very similar project where I’ve extracted text and tables from over 1mm PDF filings in large bankruptcy cases - bankrupt11.com
I still haven’t found a good way of paragraph detection. Court filings are double spaced, and the white space between paragraphs is the same as the white space between lines of text. I also can’t use tab characters because of chapter headings and lists which don’t start with a <tab>. I was hoping to get some help from anyone who has done it before.
- bobbylarrybobby 6y agoI imagine looking for lines that end prematurely would get you pretty far. Not all the way, since some last lines of paragraphs go all the way to the right margin, but combined with other heuristics it would probably work pretty well, especially if the page is justified.
- iav 6y agoNot a bad idea!
- mcswell 6y agoThis won't help you any, but we were doing OCR and then parsing a PDF dictionary. The vertical space between entries was usually enough larger than the vertical space between lines within a dictionary that we could distinguish these. Except when a dictionary entry might (or might not) have been split between columns or pages... Especially problematic were a couple entries that were more than one column or even one page in length.