4 ms·
Still waiting for GPT4V but doubt it will do this. Yes I’ve tried Donut and other options but this is a very gnarly problem. One option is to extract text bloc
by d4rkp4ttern 3y ago
Still waiting for GPT4V but doubt it will do this. Yes I’ve tried Donut and other options but this is a very gnarly problem.
One option is to extract text blocks along with their coordinates (unstructured.io gives this, probably based on another pkg because it’s basically a container for many pigs). Then do the same with a blank template, and you then have an algorithmic problem of matching the filled values spatially with the key locations from the template.
- brianjking 3y agoI'm fairly confident GPT-4V will do this just fine, tbh. You just need to extract each of the elements into a structured JSON or something, right? I'll try with your example later today.
- d4rkp4ttern 3y agoExactly, the form has filled values in named cells, so we need a JSON of cellName -> filledValue mappings. Let me know how GPT-4V does!