4 ms·
> The raw models aren't gettin that much smarter anymore, but the scaffolding and frameworks around them are. yes, that is my understanding as well, though it
by andrekandre 10mo ago
> The raw models aren't gettin that much smarter anymore, but the scaffolding and frameworks around them are.
yes, that is my understanding as well, though it gets me thinking if that is true, then what real value is the llm on the server compared to doing that locally + tools?
- theshrike79 10mo agoYou still can't beat an acre of specialized compute with any kind of home hardware. That's pretty much the power of cloud LLMs. For a tool use loop local models are getting to "OK" levels, when they get to "pretty good", most of my own stuff can run locally, basically just coordinating tool calls.