3 ms·
I just looked up a similar comment I made ~9 months ago, where I also said I thought we could probably do better than 1-to-1 prompt-to-output iteration even if
by furyofantares 3y ago
I just looked up a similar comment I made ~9 months ago, where I also said I thought we could probably do better than 1-to-1 prompt-to-output iteration even if we can't close the loop, and was hopeful that plugins would help compress the iteration.
Looking again at it from that direction - think about plugins, functions, GPTs, custom instructions, and now memory. These are all attempts to get more out of the LLM.
And they haven't really made much progress. Certainly less than I expected 9 months ago when I was hopeful the iteration loop would get compressed, even if I was highly skeptical about closing it. This is pretty conclusive to me - if it's this hard to get much more value per prompt out of current LLMs then it's really unlikely to be able to usefully close any loops.