6 ms·
Generative AI is basically like playing the game where each participant says one word of a sentence, one after the other. https://youtu.be/kNJNV0GXO-s?si=3TKUp
by geon 2y ago
Generative AI is basically like playing the game where each participant says one word of a sentence, one after the other.
https://youtu.be/kNJNV0GXO-s?si=3TKUpFoFHV7FNSHR https://youtu.be/kNJNV0GXO-s?si=3TKUpFoFHV7FNSHR
The AI has no idea where it is going before it starts outputting. If it ends up with a sentence that can’t be completed sensibly, it will output nonsense.
I think a better model needs to be able to plan out the idea to convey in advance and possibly backtrack.
- dTal 2y agoI am curious, when you started writing your comment, did you know the last word of it would be "backtrack"?
- geon 2y agoYes.
- geon 2y agoStable diffusion doesn’t start with the top left pixel and generate them one by one. Why do llms?
- XenophileJKO 2y agoThis isn't entirely correct. The models clearly demonstrate anticipatory behavior.