The problem goes much deeper than researchers not having enough PDFs. If you look at where machine learning is successful it’s usually processing spatially rela

The problem goes much deeper than researchers not having enough PDFs. If you look at where machine learning is successful it’s usually processing spatially related data. The pixels in a photograph have a spacial component where points near each other are more related than points far apart. Same goes for audio, and even text. Words in a paragraph that are close to each other are usually more related than words far apart. A spreadsheet has very little or no spacial component for a neural network to learn, and the location of an important number in a pdf probably has little to do with the number’s significance. Without a spacial component to do pattern recognition a lot of the recent advancements in machine learning like transformers or convolution get thrown out the window. There are some machine learning problems that can be solved with more or better data, but I don’t think PDF to JSON is one of them.