4 ms·

>"Tasks that seemed straightforward often took days rather than hours, with Devin getting stuck in technical dead-ends or producing overly complex, unusable sol

>"Tasks that seemed straightforward often took days rather than hours, with Devin getting stuck in technical dead-ends or producing overly complex, unusable solutions," the researchers explain in their report. "Even more concerning was Devin’s tendency to press forward with tasks that weren’t actually possible." Apparently we've all been working with Devin for years.

m463 2y ago
sometimes working for him.
plagiarist 2y ago
"Well, of course I know him. He's me."
raverbashing 2y ago
No kidding, this is noticeable even with the simpler platforms like chatgpt or copilot It gives you an answer that looks fine but lacks important details etc
- neilv 2y ago
  If an employee behaved like an LLM, a company should immediately get them into a debriefing with corporate counsel, HR, management, and trusted top technical personnel. For example, to try to find out whose IP they plagiarized, and how badly we're scrod. Or, for example, to find out how they generated so much code they don't understand at all, and how badly we're scrod. Or, for example, to find out why they wrote a criminally negligent security vulnerability or data corruption, and how badly we're scrod. Or, for example, to see what engineering assurance they "hallucinated", and how badly we're scrod.
mullingitover 2y ago
> "Even more concerning was Devin’s tendency to press forward with tasks that weren’t actually possible." Quickest way to get AI engineers kicked out of the company will be to patch them so they push back against unrealistic goals from management. Seriously though, where is the AI C-suite? The AI BoD? At least with an AI BoD you don't have to worry about them doing backstabbing financial shenanigans for their own self-interest at the expense of the company.
- xyzzy123 2y ago
  You would need much less "agreeable" AI to reliably steer a company. With current models an AI C-suite would quickly get "captured" by almost anyone interacting with it.
  - vrosas 2y ago
    Like our president, whose policy stance is the stance of whoever he last talked to.
infomofo 2y ago
I feel like this whole thing is a PR campaign to make people empathize with AI.
lolyeahokfgt 2y ago
[flagged]

m463 2y ago

sometimes working for him.

plagiarist 2y ago

"Well, of course I know him. He's me."

raverbashing 2y ago

No kidding, this is noticeable even with the simpler platforms like chatgpt or copilot It gives you an answer that looks fine but lacks important details etc

neilv 2y ago
If an employee behaved like an LLM, a company should immediately get them into a debriefing with corporate counsel, HR, management, and trusted top technical personnel. For example, to try to find out whose IP they plagiarized, and how badly we're scrod. Or, for example, to find out how they generated so much code they don't understand at all, and how badly we're scrod. Or, for example, to find out why they wrote a criminally negligent security vulnerability or data corruption, and how badly we're scrod. Or, for example, to see what engineering assurance they "hallucinated", and how badly we're scrod.

mullingitover 2y ago

> "Even more concerning was Devin’s tendency to press forward with tasks that weren’t actually possible." Quickest way to get AI engineers kicked out of the company will be to patch them so they push back against unrealistic goals from management. Seriously though, where is the AI C-suite? The AI BoD? At least with an AI BoD you don't have to worry about them doing backstabbing financial shenanigans for their own self-interest at the expense of the company.

xyzzy123 2y ago
You would need much less "agreeable" AI to reliably steer a company. With current models an AI C-suite would quickly get "captured" by almost anyone interacting with it.
- vrosas 2y ago
  Like our president, whose policy stance is the stance of whoever he last talked to.

infomofo 2y ago

I feel like this whole thing is a PR campaign to make people empathize with AI.

lolyeahokfgt 2y ago

[flagged]