3 ms·
But then you give the llm access to all internet and any other tokens it needs right?;)
by throwaway290 7mo ago
But then you give the llm access to all internet and any other tokens it needs right?;)
- kstenerud 7mo agoYou can configure a network allow-list (for anything beyond what it absolutely requires in order to function). yoloAI is just leveraging the sandboxing functionality that Docker, Kata, firecracker etc already provides.
- throwaway290 7mo agosorry. At this point it's just a meme how people give llms open access to internet, literally all passwords and all tokens and then they are actually surprised when something bad happens "but I run it in docker" even if docker sandbox escapes didn't exist it's just chef's kiss
- kstenerud 7mo agoYup, very irresponsible. And then the horror stories. yoloai new --network-isolated ... ONLY agent API traffic allowed. Everything else gets blocked by iptables. yoloai new --network-allow api.example.com --network-allow cdn.example.org ... ONLY agent API traffic + api.example.com and cdn.example.org. Everything else blocked by iptables.