3 ms·
I'm confused, "random chance" ...? If you're giving it words from a sentence it is literally the baseline functionality of the text generator to choose the mos
by chownie 3y ago
I'm confused, "random chance" ...?
If you're giving it words from a sentence it is literally the baseline functionality of the text generator to choose the most likely next token, IE to recreate the most likely sentence from the words given.
This couldbe the least meaningfully revealing task I could possibly think of trying if I were trying to find some inner monologue, if gpt had to "think" on anything this would never be it.
- famouswaffles 3y agohttps://news.ycombinator.com/item?id=35784159 https://news.ycombinator.com/item?id=35784159
- chownie 3y agoThe linked comment is a reiteration of the same thought in more words, it still makes the odd assertion against "random chance", you didn't even really give a reason except "it must be so"
- famouswaffles 3y agoCome to whatever conclusion you want lol. The point of the comment is that Blind probability, surface level probability is not enough. That should be clear enough.
- danaris 3y agoThe point of the responses to you is no one thinks it's blind probability. Constructing meaningful sentences out of words is literally the primary thing it's designed to do. Chance simply doesn't enter into the equation to any notable extent.
- famouswaffles 3y agoSurface level probability doesn't work either.
- throwaway675309 3y agoAgreed, you could achieve the same success ratio by computing the stochastic probabilities of a well trained English corpus Markov model given those same words two decades ago.
- famouswaffles 3y agoNo you actually couldn't lol. If you genuinely think this then you don't know what you're talking about.