6 ms·
> And even when ChatGPT is nevertheless wrong, its penchant for extremely-long thinking times means I'm getting my money's worth in GPU time. OpenAI most certa
by behnamoh 1y ago
> And even when ChatGPT is nevertheless wrong, its penchant for extremely-long thinking times means I'm getting my money's worth in GPU time.
OpenAI most certainly considers #thinking_tokens when deciding your rate limit. If not, models could be exploited to keep thinking for a long time to waste resources.