4 ms·
Maybe you could use: https://github.com/facebookresearch/nougat/tree/main https://github.com/facebookresearch/nougat/tree/main or https://github.com/VikParuchu
by Koaisu 3y ago
Maybe you could use:
https://github.com/facebookresearch/nougat/tree/main https://github.com/facebookresearch/nougat/tree/main
or
https://github.com/VikParuchuri/marker https://github.com/VikParuchuri/marker
Both are tools to convert pdfs into Latex or Markup with latex formulas. Maybe that helps
- acqq 3y agoReading the motivation for the second: "Relying on autoregressive forward passes to generate text is slow and prone to hallucination/repetition. From the nougat paper: We observed [repetition] in 1.5% of pages in the test set, but the frequency increases for out-of-domain documents. In my anecdotal testing, repetitions happen on 5%+ of out-of-domain (non-arXiv) pages." When these are fed in the next levels as inputs, isn't it even less surprising to get even more hallucinations/repetitions?