6 ms·
It’s also rate-limited, which means the model will silently start skipping the chain of thought after a certain number of daily requests. Definitely a downgrad
by odo1242 1y ago
It’s also rate-limited, which means the model will silently start skipping the chain of thought after a certain number of daily requests.
Definitely a downgrade over the old version, though really it’s just Google deciding to offer less for free.
- koakuma-chan 1y agoAre you sure it's rate limited? I've been using it for quite a while today and it still appears to be thinking.
- odo1242 1y agoHmm, maybe it depends? I was kinda far into a long conversation and it stopped thinking midway through. Maybe it’s based on context length and not a direct rate limit
- koakuma-chan 1y agoI feel like it doesn't think when it doesn't need to. It always been like that.
- sagarpatil 1y agoIt allows you to use your own api ke.