3 ms·
I guess you haven't used Codex/Copilot much? All good LLMs now use reasoning. Especially for code it is almost a requirement to produce correct results. But tha
by sigmoid10 3mo ago
I guess you haven't used Codex/Copilot much? All good LLMs now use reasoning. Especially for code it is almost a requirement to produce correct results. But that means even having them implement a comparatively simple function or algorithm can easily produce 3000 output tokens. Waiting 5+ minutes every time you iterate because you want a tiny tweak in the code is not a practical strategy for live development.