3 ms·

gc is negligible impact on llm agents the others ("zero dependencies") are not actually related to efficiency

• jauntywundrkind 1y ago
  It's not totally unjustified to hone in on GC as over focusing. But it feels strongly overfocusing to me. Efficiency is the top level goal, and that equates directly to performance in most computing tasks: more efficiency means being able to let other work happen. There's times where single threaded outright speed is better, but usually in computing we try as hard as possible to get parallelism or concurrency in our approaches such that efficiency can directly translate to overall performance. Overall performance as a bullet seems clear enough. Yes it's occluded by a mention of GC, but I don't think the team is stupid enough to think GC is the only performance factor win they might get here, even if they don't list other factors. Even a pretty modest bit of generosity makes me think they're doing what was asked for here. Performance very explicitly is present, and to me, I think quite clearly a clear objective.
• simianwords 1y ago
  gc is especially not relevant in async flows. i don't know what they are optimising for..