4 ms·
-> GPT 3.5 was awesome at chess I don't agree with this. I did try to play chess with GPT3.5 and it was horrible. Full of hallucinations.
by deepanwadhwa 11mo ago
-> GPT 3.5 was awesome at chess
I don't agree with this. I did try to play chess with GPT3.5 and it was horrible. Full of hallucinations.
- miki123211 11mo agoIt was GPT-3 I think. As far as I remember, it's post-training that kills chess ability for some reason (GPT-3 wasn't post-trained).
- Imustaskforhelp 11mo agoThis is so interesting, I am curious as to why, can you (or anyone) please provide any resources or insightful comments about it, they would really help a ton out here, thanks!
- pixelmelt 11mo agoGpt3 was trained on completion data so it likely saw lots of raw chess games layed out in whatever standard format moves are listed in, while 3.5 was post trained on instruct data (talking back and forth) which would have needed to explicitly include those chess games as conversational training data for it to retain as much as it would otherwise
- zurfer 11mo agoYeah I was not precise; it was `gpt-3.5-turbo-instruct`, other variants weren't trained on it apparently. https://dynomight.substack.com/p/chess https://dynomight.substack.com/p/chess