4 ms·
Using ML it is possible to parse PDF pages and interpret their layout and contents. Coupled with summarisation and text to speech it could make PDFs accessible
by visarga 6y ago
Using ML it is possible to parse PDF pages and interpret their layout and contents. Coupled with summarisation and text to speech it could make PDFs accessible to blind people. The parsing software would run on the user system and be able to cover all sorts of inputs, even images and web pages, as it is just OCR, CV and NLP.
The advantage is that PDFs become accessible immediately as opposed to the day all PDF creators would agree on a better presentation.
Example: A layout dataset - https://github.com/ibm-aur-nlp/PubLayNet https://github.com/ibm-aur-nlp/PubLayNet
and: SoundGlance: Briefing the
Glanceable Cues of Web Pages for
Screen Reader Users http://library.usc.edu.ph/ACM/CHI2019/2exabs/LBW1821.pdf http://library.usc.edu.ph/ACM/CHI2019/2exabs/LBW1821.pdf
A related problem is invoice/receipt/menu/form information extraction. Also, image based ad filtering.