44 ms·
This is Mistral though. I assume the model can be run locally.
by bee_rider 3mo ago
This is Mistral though. I assume the model can be run locally.
- idiotsecant 3mo agoSo the vacuum cleaner manufacturer would just require customers to install mistral on their local LLM hostbox? Or maybe they'd sell you a host to go with it you couldn't get into and honest cross fingers we aren't peeking!
- bee_rider 3mo agoIt is an 8B model… so, I guess it probably couldn’t run directly on most existing vacuum robots, but it could be reasonable this decade, right? I wish we lived in the alternate universe where everybody has a home server that could run this sort of thing.
- horacemorace 3mo agoOnce prices settle down it doesn’t seem unreasonable that everyone who wants modern conveniences plops down $3k for a home computer. It’s still cheaper than during the “home computer revolution” 80s/90s when normies were buying these at Sears and Radio Shack.
- bee_rider 3mo agoIt would be nice to believe that could be possible, but people mostly switched to cheap laptops as soon as they became viable. No harm in being hopeful though.
- adrianN 3mo agoThat would be a rather expensive robot vacuum.
- bee_rider 3mo agoTrue. But it would probably take a couple years to get spin up a new hardware product line anyway; by then local inference will probably be cheaper, right?