3 ms·
Sure. Here's two good examples from the published outputs. Receipts where there's no subtotal line, only a total. One model returns a subtotal anyway, "63.000"
by velrim 1mo ago
Sure. Here's two good examples from the published outputs.
Receipts where there's no subtotal line, only a total. One model returns a subtotal anyway, "63.000", "88.000", numbers it copied or computed from elsewhere in the document. Ours invented a 2% discount on a receipt that has no discount line.
TV ad contracts where the station's address isn't on the contract. Several models fill it with a real address that is on the page, just the agency's or the advertiser's. Given your industry this pattern should worry you most, since these aren't made up from nothing. Just the model tripping and taking it from the wrong place, which might look plausible on the surface.
Here's what I'd suggest for your vendor demos. Run them on a handful of your own documents where you know a field is genuinely absent, and count how many come back filled. Their own samples won't tell you that.
All the raw outputs are here if you want to look: https://velrim.com/research/fabrication-on-absent-fields https://velrim.com/research/fabrication-on-absent-fields