4 ms·
Yeah, v4 flash is dirt cheap, but it's running in circles quite often. Might very well be that a better model is cheaper if it gets things right the first try.
by k__ 3mo ago
Yeah, v4 flash is dirt cheap, but it's running in circles quite often.
Might very well be that a better model is cheaper if it gets things right the first try.
Maybe I should route to a better model when v4flash hasn't solved after a specific number of tokens.