3 ms·
For those wondering how to answer "what do you want to see from an open model" I put this in: an open weights end to end multimodal model, a model large enough
by vessenes 2y ago
For those wondering how to answer "what do you want to see from an open model" I put this in: an open weights end to end multimodal model, a model large enough to act as a functional teacher along with a range of nicely distilled smaller sizes, code repo to make training / finetuning easy.
As I write this, I'd also like to request a set of tool calling LLMs in various sizes. Feels to me like a small fast local tool calling assessor with a large context to support a lot of MCP functions would be very useful locally.
- nickthegreek 2y agoId hope they will also start to target machines with 128gb of unified ram now that we seem to have at least 3 options on that front.
- politelemon 2y agoI'd rather see more openness and the ability to run on commodity hardware. There are hundreds of options on that front.
- impossiblefork 2y agoI think that when learning privacy and being able to run things oneself is less of a problem. Keeping ones work confidential becomes interesting once one starts doing new things, so while it would be fun, I don't think that's the most useful type of open model. I think code models are probably the most useful.
- verdverm 2y agoHow about everything needed for full reproducibility? This is what I would like to see
- vessenes 2y agoSeems unlikely. :) As is an end to end multimodal model, I'd guess. But we can ask!
- EGreg 2y agoand guess what they did announce they'll release open weights :) https://x.com/sama/status/1906793591944646898?s=46&t=6NqVriDzUg62-oO7pw1olA https://x.com/sama/status/1906793591944646898?s=46&t=6NqVriD... to be honest many of us never saw that coming... LOL
- vessenes 2y agoI don’t think it will be an end to end multimodal model, unless they’re holding that shocker for later - he says “language model” in the announcement. So basically o3 mini, not 4o multimodal.