4 ms·

imo switch to local models could be an option

• Barathkanna 7mo ago
  Local models solve the marginal cost problem, but they move the complexity into infrastructure and throughput planning instead.
  • clearloop 7mo ago
    makes sense, it really depends on the use cases, I'm building my version of claw openwalrus for the local LLMs first goal, I think myself will use local models for daily tasks that heavily depend on tool callings, but for coding or doing research, I'll keep using remote models and this topic actually inspires me that I can introduce a builtin gas meter for tokens