4 ms·
Do an improv exercise with a friend. Construct a story about a sentient apple one word at a time. I guarantee you that at one point one of you will set up the o
by IgorPartola 4y ago
Do an improv exercise with a friend. Construct a story about a sentient apple one word at a time. I guarantee you that at one point one of you will set up the other with an “an” in your story. This is how I believe this works.
- minkzilla 4y agoYour friend is thinking ahead that the next word would be apple When they say ‘an’. But GPT can’t think ahead what token it will add after the one it is on. Or can it? It could “predict” internally the word apple for the next “meaningful” word and output ‘an’ because of this.
- IgorPartola 4y agoOr it could keep outputting articles where appropriate until it outputs an “an” and then output apple having teed itself up.