4 ms·

'Adjust accordingly' includes giving up and delivering something similar to what I asked, but not what I asked; is this the point at which the circle is complet

'Adjust accordingly' includes giving up and delivering something similar to what I asked, but not what I asked; is this the point at which the circle is complete and AI has fully replaced my dev team?

foobarian 3y ago
Well in the example of an NP complete problem, a human might realize they are having trouble coming up with an optimal solution and start analyzing complexity. And once they have a proof might advise you accordingly and perhaps suggest a good enough heuristic.
- lazide 3y ago
  Have you managed dev teams before? It's really nice when they do that, but that is far from the common case.
- flextheruler 3y ago
  Is the commenter above you implying humans hallucinate to the level of LLMs? Maybe hungover freshman working on a tight deadline without having read the book do, but not professionals. Even a mediocre employees will often realize they’re stuck, seek assistance, and then learn something from the assistance instead of making stuff up.
  - groestl 3y ago
    Depending on the country / culture / job description, "making stuff up" is sometimes a viable option for "adjust accordingly", on all levels of expertise.
  - pixl97 3y ago
    People commonly realize when they are stuck... But note, the LLM isn't stuck, it keeps producing (total bullshit) material, and this same problem happens with humans all the time when they go off on the wrong tangent and some supervisory function (such as the manager of a business) has to step in and ask wtf they are up to.
  - mr_toad 3y ago
    > Even a mediocre employees will often realize they’re stuck, seek assistance, and then learn something from the assistance instead of making stuff up. Only if they’re aware of their mediocrity. It’s the ones who aren’t, who bumble on regardless who are dangerous - just like AI.
skywhopper 3y ago
One thing a human might do that I’ve never seen an LLM do is ask followup and clarifying questions to determine what is actually being requested.
- ericb 3y ago
  What makes this fascinating to me is, these LLM's were trained on an internet filled with tons of examples of humans asking clarifying questions. Why doesn't the LLM do this? Why is the "next, most-likely token" never a request for clarification?
- bongodongobob 3y ago
  GPT4 absolutely asks for clarification all the time.
steveBK123 3y ago
Everyone assumes the AI is going to replace their employees but not replace them.. fascinating.
- Jensson 3y ago
  Uber proves we can replace Taxi management with simple algorithms, that was apparently much easier than replacing the drivers. I hope these bigger models can replace management in more industries, I'd love to have an AI as a manager.
  - steveBK123 3y ago
    Yeah on the one hand people think AI management id dystopian (probably lol), on the other hand probably fewer than 50% of ICs promoted to management are good at it. North of 25% are genuinely bad at it. We've all worked for several of these. Many of us have tried our hand at management and then moved back to senior IC tracks. Etc.

foobarian 3y ago

Well in the example of an NP complete problem, a human might realize they are having trouble coming up with an optimal solution and start analyzing complexity. And once they have a proof might advise you accordingly and perhaps suggest a good enough heuristic.

lazide 3y ago
Have you managed dev teams before? It's really nice when they do that, but that is far from the common case.
flextheruler 3y ago
Is the commenter above you implying humans hallucinate to the level of LLMs? Maybe hungover freshman working on a tight deadline without having read the book do, but not professionals. Even a mediocre employees will often realize they’re stuck, seek assistance, and then learn something from the assistance instead of making stuff up.
- groestl 3y ago
  Depending on the country / culture / job description, "making stuff up" is sometimes a viable option for "adjust accordingly", on all levels of expertise.
- pixl97 3y ago
  People commonly realize when they are stuck... But note, the LLM isn't stuck, it keeps producing (total bullshit) material, and this same problem happens with humans all the time when they go off on the wrong tangent and some supervisory function (such as the manager of a business) has to step in and ask wtf they are up to.
- mr_toad 3y ago
  > Even a mediocre employees will often realize they’re stuck, seek assistance, and then learn something from the assistance instead of making stuff up. Only if they’re aware of their mediocrity. It’s the ones who aren’t, who bumble on regardless who are dangerous - just like AI.

skywhopper 3y ago

One thing a human might do that I’ve never seen an LLM do is ask followup and clarifying questions to determine what is actually being requested.

ericb 3y ago
What makes this fascinating to me is, these LLM's were trained on an internet filled with tons of examples of humans asking clarifying questions. Why doesn't the LLM do this? Why is the "next, most-likely token" never a request for clarification?
bongodongobob 3y ago
GPT4 absolutely asks for clarification all the time.

steveBK123 3y ago

Everyone assumes the AI is going to replace their employees but not replace them.. fascinating.

Jensson 3y ago
Uber proves we can replace Taxi management with simple algorithms, that was apparently much easier than replacing the drivers. I hope these bigger models can replace management in more industries, I'd love to have an AI as a manager.
- steveBK123 3y ago
  Yeah on the one hand people think AI management id dystopian (probably lol), on the other hand probably fewer than 50% of ICs promoted to management are good at it. North of 25% are genuinely bad at it. We've all worked for several of these. Many of us have tried our hand at management and then moved back to senior IC tracks. Etc.