4 ms·
Haha we are in such a bubble. All engineering concepts are being thrown in the trash. We already have problems with prompt injections in MCP (eg supabase thread
by deepdarkforest 1y ago
Haha we are in such a bubble. All engineering concepts are being thrown in the trash. We already have problems with prompt injections in MCP (eg supabase thread yesterday). Imagine the possibilities when you allow the LLM itself to write and execute arbitrary code that directly has access to sensitive info. This is the equivalent of allowing a malware to not only just execute code, but give the malware developer free reign to write his bespoke code for your machine.
Outside of that, writing your own tools on the fly it's clear waste of tokens/money, plus makes benchmarking and evaluation way more difficult, it's another degree of freedom etc. People never think with first principles in mind anymore. Just the quickest cute solution to anything, with not the slightest consideration any side effects