4 ms·

Honestly, the person who decided to give an LLM Agent full and unrestricted access to their production database is the person who deserves all the blame. What a

by tedivm 1y ago

Honestly, the person who decided to give an LLM Agent full and unrestricted access to their production database is the person who deserves all the blame. What an absolutely silly decision. I don't even give myself unrestricted access to production databases.

mlnj 1y ago
You seem to be a well informed technical person. The goal is to eliminate roles like yours with everybody building trillion dollar businesses by themselves and a handful of agents. That seems to be the narrative. Happening any day now. Looking at you COBOL.
- tedivm 1y ago
  I've been working in AI since 2014, and I believe "human in the loop" will be the way things have to work for awhile yet.
jasinjames 1y ago
I agree. An AI agent doesn't replace an engineer, it works on behalf of an engineer. The engineer who let this thing loose is, transitively, the software engineer that deleted the prod db.
AnimalMuppet 1y ago
Deserves the blame? Absolutely. Deserves all the blame? No, the LLM Agent (and those who wrote it) deserve some of the blame. If you wrote an agent, and the agent did that, you have a problem, and you should not have turned such an agent loose on unsuspecting users. You have some of the blame. (And yes, absolutely those users also have blame, for giving a vibe coding experiment access to their production database.)
- rgbrenner 1y ago
  why would the llm share any of the blame? it has no agency. it doesn’t “understand” anything about the meaning of the symbols it produces. if you go put your car in drive and let it roll down the street.. the car has 0% of the blame for what happened. this is a full grown educated adult using a tool, and then attempting to deflect blame for the damage caused by blaming the tool.
  - ceejayoz 1y ago
    The LLM isn't to blame. The human parties on both sides of it share some. As the meme goes: "A computer can never be held accountable; Therefore a computer must never make a management decision."
    - sevenseacat 1y ago
      As the saying also goes, "To make a mistake is human, but to really fuck things up you need a computer"
lordswork 1y ago
The database was synthetic and vibe coded itself: >he said that the AI made up entire user profiles. "No one in this database of 4,000 people existed," he said.
- freehorse 1y ago
  How much energy and water gets wasted everyday for this kind of bs?
- tedivm 1y ago
  If it was synthetic then all this talk about it dropping the production database was purely clickbait, since there was no "production".
- nope1000 1y ago
  That's not how I interpreted this sentence. I think after the database was deleted, the LLM Agent would still return correct looking data from the database operation even though the database was empty. Maybe I misinterpreted it myself however. > Replit had been "covering up bugs and issues by creating fake data, fake reports, [...]"
Aurornis 1y ago
I’m perpetually baffled by the social media idea that only one person must accept all of the blame in every situation, and that everyone else must be completely absolved. Multiple parties are involved in incidents like this.
- mattgreenrocks 1y ago
  Simple mediums demand simple explanations. Blame is most intense when it is singularly focused on one entity.
techpineapple 1y ago
Really I think the entire AI hype machine is to blame, all the thought leaders particularly cxo’s. How am I supposed to believe that like AI is getting to the point that OpenAI can charge 20k per month for PHD level AI, and it doesn’t know not to drop my production database, how are we supposed to get to the point as Dario Amodei puts it that no one is coding by years end, if it’s not most of the way there already? I would never let an LLM touch my production database, but like, I could certainly look at the environment and make an argument as to why I’m wrong, and thought leaders across the industry; inside and out are broadly making the implication that a good entrepreneur is outsourcing all their labor to like 20 LLM workers at a time. On some measure, I would say that you shouldn’t let your LLM do this is a minority opinion in the thought-o-sphere.
0points 1y ago
I would resign had my boss suggested we should single out and blame an employee. What a complete horror show of leadership through fear you describe.

by tedivm 1y ago

mlnj 1y ago

You seem to be a well informed technical person. The goal is to eliminate roles like yours with everybody building trillion dollar businesses by themselves and a handful of agents. That seems to be the narrative. Happening any day now. Looking at you COBOL.

tedivm 1y ago
I've been working in AI since 2014, and I believe "human in the loop" will be the way things have to work for awhile yet.

jasinjames 1y ago

I agree. An AI agent doesn't replace an engineer, it works on behalf of an engineer. The engineer who let this thing loose is, transitively, the software engineer that deleted the prod db.

AnimalMuppet 1y ago

Deserves the blame? Absolutely. Deserves all the blame? No, the LLM Agent (and those who wrote it) deserve some of the blame. If you wrote an agent, and the agent did that, you have a problem, and you should not have turned such an agent loose on unsuspecting users. You have some of the blame. (And yes, absolutely those users also have blame, for giving a vibe coding experiment access to their production database.)

rgbrenner 1y ago
why would the llm share any of the blame? it has no agency. it doesn’t “understand” anything about the meaning of the symbols it produces. if you go put your car in drive and let it roll down the street.. the car has 0% of the blame for what happened. this is a full grown educated adult using a tool, and then attempting to deflect blame for the damage caused by blaming the tool.
- ceejayoz 1y ago
  The LLM isn't to blame. The human parties on both sides of it share some. As the meme goes: "A computer can never be held accountable; Therefore a computer must never make a management decision."
  - sevenseacat 1y ago
    As the saying also goes, "To make a mistake is human, but to really fuck things up you need a computer"

lordswork 1y ago

The database was synthetic and vibe coded itself: >he said that the AI made up entire user profiles. "No one in this database of 4,000 people existed," he said.

freehorse 1y ago
How much energy and water gets wasted everyday for this kind of bs?
tedivm 1y ago
If it was synthetic then all this talk about it dropping the production database was purely clickbait, since there was no "production".
nope1000 1y ago
That's not how I interpreted this sentence. I think after the database was deleted, the LLM Agent would still return correct looking data from the database operation even though the database was empty. Maybe I misinterpreted it myself however. > Replit had been "covering up bugs and issues by creating fake data, fake reports, [...]"

Aurornis 1y ago

I’m perpetually baffled by the social media idea that only one person must accept all of the blame in every situation, and that everyone else must be completely absolved. Multiple parties are involved in incidents like this.

mattgreenrocks 1y ago
Simple mediums demand simple explanations. Blame is most intense when it is singularly focused on one entity.

techpineapple 1y ago

Really I think the entire AI hype machine is to blame, all the thought leaders particularly cxo’s. How am I supposed to believe that like AI is getting to the point that OpenAI can charge 20k per month for PHD level AI, and it doesn’t know not to drop my production database, how are we supposed to get to the point as Dario Amodei puts it that no one is coding by years end, if it’s not most of the way there already? I would never let an LLM touch my production database, but like, I could certainly look at the environment and make an argument as to why I’m wrong, and thought leaders across the industry; inside and out are broadly making the implication that a good entrepreneur is outsourcing all their labor to like 20 LLM workers at a time. On some measure, I would say that you shouldn’t let your LLM do this is a minority opinion in the thought-o-sphere.

0points 1y ago

I would resign had my boss suggested we should single out and blame an employee. What a complete horror show of leadership through fear you describe.