3 ms·
I think that there is fantastic potential in having open-weight, OS-standard foundation models. Especially if the API gives opportunity for app developers to l
by HanClinto 1y ago
I think that there is fantastic potential in having open-weight, OS-standard foundation models.
Especially if the API gives opportunity for app developers to load their custom LoRa fine-tunings onto OS-standard foundation models at runtime, then you can (ideally) have the best of both worlds -- fine-tuned app-specific models with reasonable app sizes.
- HappMacDonald 1y agoI haven't seen much done with loras for LLMs though, only for diffusion image gen models. From what I've heard it sounds like a difference in benefit due to architecture.