4 ms·

Yeah, I suspect the main reason this was rejected is simply because it's not fixable. This is just how LLMs work. This LLM ingests untrusted data, so there will

Yeah, I suspect the main reason this was rejected is simply because it's not fixable. This is just how LLMs work. This LLM ingests untrusted data, so there will always be a non-zero chance that this type of prompt injection succeeds.

27183 3mo ago
This makes me crazy. When I started my career in software the focus was on security, correctness, uptime (measured in nines--remember those?), and performance. Features are important, but building a crap feature is worse than building no feature at all. I don't understand how these systems are passing the bar. You would have been fired for trying to railroad something like this into production 10-15 years ago. What happened?
- wrs 3mo ago
  I suspect when those 10-digit wire transfers start arriving in your bank account, your attitude changes rapidly.
  - 27183 3mo ago
    Speaking personally, approximately one minute after a 10 digit wire transfer arrives in my account I will disappear permanently to sail the seas on my yacht. What would be the incentive to continue working? Personal finances aside, that's no way to run a business. Torching your brand, alienating your users, and pissing off your customers is a well known path to ruin. [edit] Even if it results in some temporary windfall--is the thesis that the windfall will be so big they no longer need users or customers? It eludes me completely what the companies that are building this trash now are hoping to achieve. It's especially galling that publicly traded companies are doing it. It's one thing for a startup to blow a bunch of venture capital on a speculative, half-baked product idea. Great risks sometimes yield great rewards. Usually they don't. Founders and VCs knowingly and willingly sign up for those risks. It's a totally different story for public companies.

4 ms·

Yeah, I suspect the main reason this was rejected is simply because it's not fixable. This is just how LLMs work. This LLM ingests untrusted data, so there will

by InsideOutSanta 3mo ago

27183 3mo ago
This makes me crazy. When I started my career in software the focus was on security, correctness, uptime (measured in nines--remember those?), and performance. Features are important, but building a crap feature is worse than building no feature at all. I don't understand how these systems are passing the bar. You would have been fired for trying to railroad something like this into production 10-15 years ago. What happened?
- wrs 3mo ago
  I suspect when those 10-digit wire transfers start arriving in your bank account, your attitude changes rapidly.
  - 27183 3mo ago
    Speaking personally, approximately one minute after a 10 digit wire transfer arrives in my account I will disappear permanently to sail the seas on my yacht. What would be the incentive to continue working? Personal finances aside, that's no way to run a business. Torching your brand, alienating your users, and pissing off your customers is a well known path to ruin. [edit] Even if it results in some temporary windfall--is the thesis that the windfall will be so big they no longer need users or customers? It eludes me completely what the companies that are building this trash now are hoping to achieve. It's especially galling that publicly traded companies are doing it. It's one thing for a startup to blow a bunch of venture capital on a speculative, half-baked product idea. Great risks sometimes yield great rewards. Usually they don't. Founders and VCs knowingly and willingly sign up for those risks. It's a totally different story for public companies.