3 ms·
A smart performant local model will be the equivalent of having good anti-virus and firewall software. It will be the only thing between you and wrong prompts b
by ivape 1y ago
A smart performant local model will be the equivalent of having good anti-virus and firewall software. It will be the only thing between you and wrong prompts being sent every which way from which app.
We’re probably three or four years away from the hardware necessary for this (NPUs in every computer).
- ec109685 1y agoA local LLM wouldn’t have helped at all here.
- ivape 1y agoYou can’t imagine a MITM LLM that sits between you and the world?
- QuadmasterXLII 1y agoLocal llms can get offline searched for vulnerabilities using gradient based attacks. they will always be very easy to prompt inject.
- solid_fuel 1y agoI can't imagine how such a thing would _help_, it seems like it would just be another injection target.