3 ms·
Yeah, if a software engineer came up with such vulnerable idea, they would be fired instantly. Wait a second, LLMs are the product of software engineers.
by amelius 9mo ago
Yeah, if a software engineer came up with such vulnerable idea, they would be fired instantly.
Wait a second, LLMs are the product of software engineers.
- koakuma-chan 9mo agoWould they? I don't think anyone cares about security.
- jstummbillig 9mo agoPeople have the grandest ideas about standards in software engineering since right about ai started dabbling in software engineering. It's uncanny.
- tstrimple 9mo agoIt seems like folks have forgotten again what the S in IOT stands for. This shit has been terrible for... well since always really.
- Legend2440 9mo agoThis is just the price of being on the bleeding edge. Unfortunately, prompt injection does strongly limit what you can safely use LLMs for. But people are willing to accept the limitations because they do a lot of really awesome things that can't be done any other way. They will figure out a solution to prompt injection eventually, probably by training LLMs in a way that separates instructions and data.
- cherioo 9mo agoIt’s like money laundering, but now responsibility laundering. Anthropic released Claude saying “hey be careful. But now that enables the masses to build OpenClaw and go “hold my bear”. Now the masses people using OpenClaw had no idea what responsibility they should hold. I think eventually we will have laws like “you are responsible for your AI’s work”. Much like how driver is (often) responsible for car crashes, not the car companies.