3 ms·
Local models solve the marginal cost problem, but they move the complexity into infrastructure and throughput planning instead.
by Barathkanna 7mo ago
Local models solve the marginal cost problem, but they move the complexity into infrastructure and throughput planning instead.
- clearloop 7mo agomakes sense, it really depends on the use cases, I'm building my version of claw openwalrus for the local LLMs first goal, I think myself will use local models for daily tasks that heavily depend on tool callings, but for coding or doing research, I'll keep using remote models and this topic actually inspires me that I can introduce a builtin gas meter for tokens