3 ms·

I see this as an example of the reverse: AI is still stupid enough that it takes humans a degree of skill to craft a request which generates the desired output.

srcreigh 4y ago
Kolmogorov complexity would like a word! It seems intractable for AI to read minds, there should always be some degree of skill involved in prompt writing.
- ineedasername 4y ago
  Agreed. But I think we may reach a point where it is difficult to prompt the most advance AI (which may are may note be an LLM, though maybe contain an LLM mode) in a productive way, especially due to computational demands on resources. And so AI's with lesser, cheaper capabilities may be reasonably competent in "understanding"-- a term I user very loosely-- the problem of dealing with more advanced but resource constrained systems and assist in the best practices in prompting them.
unshavedyak 4y ago
I don't know how true it is vs how much PR it is, but Khan Academy's use of LLMs was interesting in that they apparently craft a prompt from the AI itself. Ie a two step process where the AI generates the steps, and then the AI reasons about the result of the steps to attempt and judge the accuracy of the data. This was just a blurb from the Ted talk[1], but i'd be interested in seeing a slightly more in depth explanation about this strategy. Made me wonder if you could have an recursive cycle of thinking. Where the "AI" prompts itself, reasons on the output, and does that repeatedly with guards such that it will stop if it doesn't judge anymore advancement. [1]: https://www.youtube.com/watch?v=hJP5GqnTrNo&t=715s https://www.youtube.com/watch?v=hJP5GqnTrNo&t=715s
- bionhoward 4y ago
  You can, I’m doing it right now
- copperx 4y ago
  That's called AutoGPT.
Yiin 4y ago
From what I've seen, the problem is not with the GPT models, but the people themselves. Almost everyday I get multiple unstructured, unclear and often without required context requests from people that I need to iterate back and forth with additional questions to get a clear view what they're trying to achieve. The only thing GPT is "stupid enough" is that it's not prompted to ask questions back to clarify the request.
- hnlmorg 4y ago
  That’s my point though, us humans get better at working with abysmal directions the more we encounter it. Current AI, on the other hand, requires humans to improve to meet AI cannot still take those inputs literally, warts and all.
- QuantumGood 4y ago
  I almost always ask it to also ask me clarifying questions.
Matticus_Rex 4y ago
Is that a useful range in which to use "stupid?" Humans are also stupid in that way.

srcreigh 4y ago

Kolmogorov complexity would like a word! It seems intractable for AI to read minds, there should always be some degree of skill involved in prompt writing.

ineedasername 4y ago
Agreed. But I think we may reach a point where it is difficult to prompt the most advance AI (which may are may note be an LLM, though maybe contain an LLM mode) in a productive way, especially due to computational demands on resources. And so AI's with lesser, cheaper capabilities may be reasonably competent in "understanding"-- a term I user very loosely-- the problem of dealing with more advanced but resource constrained systems and assist in the best practices in prompting them.

unshavedyak 4y ago

I don't know how true it is vs how much PR it is, but Khan Academy's use of LLMs was interesting in that they apparently craft a prompt from the AI itself. Ie a two step process where the AI generates the steps, and then the AI reasons about the result of the steps to attempt and judge the accuracy of the data. This was just a blurb from the Ted talk[1], but i'd be interested in seeing a slightly more in depth explanation about this strategy. Made me wonder if you could have an recursive cycle of thinking. Where the "AI" prompts itself, reasons on the output, and does that repeatedly with guards such that it will stop if it doesn't judge anymore advancement. [1]: https://www.youtube.com/watch?v=hJP5GqnTrNo&t=715s https://www.youtube.com/watch?v=hJP5GqnTrNo&t=715s

bionhoward 4y ago
You can, I’m doing it right now
copperx 4y ago
That's called AutoGPT.

Yiin 4y ago

From what I've seen, the problem is not with the GPT models, but the people themselves. Almost everyday I get multiple unstructured, unclear and often without required context requests from people that I need to iterate back and forth with additional questions to get a clear view what they're trying to achieve. The only thing GPT is "stupid enough" is that it's not prompted to ask questions back to clarify the request.

hnlmorg 4y ago
That’s my point though, us humans get better at working with abysmal directions the more we encounter it. Current AI, on the other hand, requires humans to improve to meet AI cannot still take those inputs literally, warts and all.
QuantumGood 4y ago
I almost always ask it to also ask me clarifying questions.

Matticus_Rex 4y ago

Is that a useful range in which to use "stupid?" Humans are also stupid in that way.