3 ms·
Yes, agreed, but I think it’s going to be difficult to have a high quality model that “does it all” and have it be local. For a quality “does it all” model, you
by drob518 2mo ago
Yes, agreed, but I think it’s going to be difficult to have a high quality model that “does it all” and have it be local. For a quality “does it all” model, you’re going to need a lot of parameters and that means you’re almost always going to be running in the cloud. But it seems like you could probably get a smaller, focused model that runs locally and is also high quality. In other words, I want the programming expert portion of a 2T model that is maybe 35B or 70B parameters or whatever but it’s running locally (and yes, I know you don’t just carve out an expert from a larger model, but conceptually that’s what I’m after).
- fennecfoxy 2mo agoYeah, I always thought the future of this stuff would be hot-pluggable MoE modules or LORAs that are able to be downloaded and applied/used at will like how skills have become a thing. Like, atm most architectures seem limited by a single context and fixed architecture with no hot loading. Especially for robotics, being able to load/unload various specialised skills on limited mobile hardware will (I hope) definitely become a thing.