2 ms·
Are you sure it's rate limited? I've been using it for quite a while today and it still appears to be thinking.
by koakuma-chan 1y ago
Are you sure it's rate limited? I've been using it for quite a while today and it still appears to be thinking.
- odo1242 1y agoHmm, maybe it depends? I was kinda far into a long conversation and it stopped thinking midway through. Maybe it’s based on context length and not a direct rate limit
- koakuma-chan 1y agoI feel like it doesn't think when it doesn't need to. It always been like that.