2 ms·
We seem to be talking at cross purposes. I understand (at a very high level) what LLMs do, and I don't think they can do actual computation. Why do you insist
by the_af 4y ago
We seem to be talking at cross purposes. I understand (at a very high level) what LLMs do, and I don't think they can do actual computation.
Why do you insist on things I've already said I understand? I know ChatGPT is not good at maintaining state -- though it can fake it convincingly (which understandably, seems to trip people up). I think it looks at your chat history within the session in order to generate the next response, which is why it can "degenerate" within a single session (but also, it's how it can fake and make it seem it's keeping state, by looking at the whole history before each reply).
I don't understand the rest of your answer. You seem to be really upset at "the people".
PS:
> So by induction once we know that the bestMove function is correct
"By induction", nope. Prove it. Run an actual full game instead of arguing with me. It will take you shorter to play the game than to debate with me.
- kazinator 4y agoWhat's the difference between keeping state and looking at the chat history? Keeping state is something a human would have to do, because for a human, it would be very tedious and slow to re-read the history to recover context, relative to the timeliness expectation of the interlocutor.
- the_af 4y ago> What's the difference between keeping state and looking at the chat history? That's an excellent question. I don't know. Intuitively, looking at the chat history would seem a way to keep history, right? However, in my tests trying to play Tic Tac Toe (informally, not using javascript functions as the comment I was replying to) ChatGPT constantly failed. It claims to know the rules of Tic Tac Toe, yet it repeatedly forgot past board positions, making me think it's not capable of using the chat history to build a model of the game.