3 ms·
Slower tokens, maintenance time (installing new models/updating tools), lower SWE bench scores. For me it’s not worth it - optimize for speed. If I worked on a
by scosman 1y ago
Slower tokens, maintenance time (installing new models/updating tools), lower SWE bench scores. For me it’s not worth it - optimize for speed.
If I worked on a codebase I couldn’t send to the hosted tools I’d go this route in a heartbeat.