3 ms·
I was recently thinking of a backend for code execution for LLMs. It's hard to run Python safely in a box. For the moment the idea is shelved.
by visarga 4y ago
I was recently thinking of a backend for code execution for LLMs. It's hard to run Python safely in a box. For the moment the idea is shelved.
- KRAKRISMOTT 4y ago> I was recently thinking of a backend for code execution for LLMs. It's hard to run Python safely in a box. Sandboxing Python can be done fairly easily with either WebAssembly or a low profile hypervisor solution like Firecracker. See the Toolformer paper for more uses of connecting LLMs to existing technical infrastructure. You might also find the ACT-1 transformer to be somewhat relevant.