7 ms·
Cool. Another AI project written in Rust! The local model has been a great idea for privacy and compliance! Which local models do you think can support this kin
by Nicole9 9mo ago
Cool. Another AI project written in Rust! The local model has been a great idea for privacy and compliance! Which local models do you think can support this kind of agent? I suppose you need at least a 140B model to work well?
- rctstudio2018 9mo agoYes, you'd need some kind of edge computing to actually cowork with for this architecture. For now, I would recommend stick with some Tier 1 models like Claude sonnet 4.5, GPT 5.2, etc. But I highly believe open source models will catch up soon and there are lots of potentials there comparing to closed cloud models.