3 ms·
I made something that replaces sensitive (and proprietary) objects that you could have in your LLM query and replace it with a random noun. Your LLM response ca
by prprasad 3y ago
I made something that replaces sensitive (and proprietary) objects that you could have in your LLM query and replace it with a random noun. Your LLM response can be pasted back to get your answer with the original objects. Everything happens on the browser side, so this was a fun little project.
- Cilvic 3y agoI'm curious in something like this as well not only for sharing with AI but sharing in general. Would be great to have a filter for copy paste of logs but also screenshots. Key would be to identify the potentially harmful information instead of having to maintain a blacklist of secrets that I want to be removed. Maybe the tool could learn over time which phrases/words I'd want removed.
- prprasad 3y agoHi, quite some interesting ideas, maybe I can share my two cents as well. - Indeed, I have seen news of Samsung docs landing up in an LLM response which made me realize that having restrictions in place isn't going to stop people from using the tech, but its important to be safe (especially when dealing with black-boxes like LLMs). Over general sharing, I always thought redacting is a useful tool in that aspect over something like this. - Indeed, but this adds another level of complexity of OCR (can't use some kind of vision LLM since that defeats the purpose). - I'd say its always good to start with a blacklist; over time indeed nouns or objects can be semantically identified (in this day and age even with self-hosted LLMs). But I can already foresee a bit of effort and a lot of complexity. I also don't think touting a completely online tool is wise for security. That's why this is an Electron app that can be taken offline too (i.e. what I intended for).