3 ms·
One recurring problem I have with Claude 2 is that it sometimes "bugs out" and starts to repeat the same token ad infinitum (which I still have to pay for). Thi
by dr_kiszonka 3y ago
One recurring problem I have with Claude 2 is that it sometimes "bugs out" and starts to repeat the same token ad infinitum (which I still have to pay for). This happens with longer prompts, say, 30k. Have you encountered this issue?
- senko 3y agoI haven't, but tbh we work a lot more with GPT than Claude so it's possible I haven't encountered many warts there. For what we do (AI code writing), GPT output seems qualitatively much better than Claude's, but we want to keep our options open.
- dr_kiszonka 3y agoThanks! I use it for classification for a personal project (non-commercial) and, for me, they are both pretty close in terms of quality. GPT-4 is better, but has a shorter window. I was hoping to reduce costs by using Claude exclusively, but that bug makes it too unreliable, sadly.