3 ms·
I get really nervous about using LLMs for OCR due to the risk of both prompt injection (instructions in the OCR'd text causing the model to behave differently)
by simonw 3y ago
I get really nervous about using LLMs for OCR due to the risk of both prompt injection (instructions in the OCR'd text causing the model to behave differently) and also the risk from safety filters - I don't want an OCR tool that refuses to output text from a document if that text contains offensive language, for example.
- actionfromafar 3y agoWell if it refuses, that's at least easier to spot and handle than if direction of the output is "re-directed" so to speak.