3 ms·
It has limited token length; I think the chatgpt one has 8k, but they have a version with 32k now as well. That includes input and output in that length. It wil
by anonzzzies 4y ago
It has limited token length; I think the chatgpt one has 8k, but they have a version with 32k now as well. That includes input and output in that length. It will ‘forget’ the start of the conversation if the conversation is too long compared to that length. They maybe use tricks like summerization, but that won’t help with chess or other precise conversations.
- nullc 4y ago> but that won’t help with chess or other precise conversations. Not necessarily true: the summerization might happen to give the board state! Certainly you can come up with an input that would make it summarize that way, though getting that outcome from a generic summerization prompt would be more surprising.
- anonzzzies 4y agoYes, certainly if you prompt it to do so. Or pass the board efficiently. I just don’t think it’s set up like that currently seeing it’s amnesia of the positions.