Agreed, and notably, the people with safety concerns are already regularly "losing" to product designers who want more capabilities. Wuzzie's blog (https://emb

Agreed, and notably, the people with safety concerns are already regularly "losing" to product designers who want more capabilities. Wuzzie's blog (https://embracethered.com/blog/ https://embracethered.com/blog/) has a number of examples of data exfiltration that would be largely prevented by merely sanitizing Markdown output and refusing to auto-fetch external resources like images in that Markdown output. In some cases, companies have been convinced to fix that. But as far as I know, OpenAI still refuses to change that behavior for ChatGPT, even though they're aware it presents an exfiltration risk. And I think sanitizing Markdown output in the client, not allowing arbitrary image embeds from external domains -- it's the bottom of the barrel, it's something I would want handled in many applications even if they weren't being wired to an LLM. ---- It's tricky to link to older resources because the space moves fast and (hopefully) some of these examples have changed or the companies have introduced better safeguards, but https://kai-greshake.de/posts/in-escalating-order-of-stupidity/ https://kai-greshake.de/posts/in-escalating-order-of-stupidi... highlights some of the things that companies are currently trying to do with LLMs, including "wire them up to external data and then use them to help make military decisions." There are a subset of people who correctly point out that with very careful safeguards around access, usage, input, and permissions, these concerns can be mitigated either entirely or at least to a large degree -- the tradeoff being that this does significantly limit what we can do with LLMs. But the overall corporate space either does not understand the risks or is ignoring them.