3 ms·
Hmm, that could be. It happens with different prompts when the number of input tokens is over a certain length. Fascinating how hard these kind of issues are t
by ylere 3y ago
Hmm, that could be. It happens with different prompts when the number of input tokens is over a certain length.
Fascinating how hard these kind of issues are to debug.
- throwawayadvsec 3y agoIf it's about the length it maybe due to optimizations for the large context length