4 ms·
The article links to an example of GPT-4 failing to solve it. It seems likely that it can only solve it sometimes and basically gets “lucky”.
by MattRix 3y ago
The article links to an example of GPT-4 failing to solve it. It seems likely that it can only solve it sometimes and basically gets “lucky”.
- maroonblazer 3y agoThis is interesting. When I started a new chat, first with the apples problem, then followed by the seating problem, GPT-4 gets it wrong. https://chat.openai.com/share/1c04a8f6-2ed7-45bf-8e20-158f78b29b8c https://chat.openai.com/share/1c04a8f6-2ed7-45bf-8e20-158f78...
- packetlost 3y agoThat's because it's got a randomizer component at its core and only knows the statistically most likely thing to output next (still influenced by the random bits), not some logical reasoning that allows it to "understand" the question.
- hackinthebochs 3y agoIt's output is non-deterministic because the next word is sampled from the topN highest scored continuations. The algorithm itself is deterministic.