A mac mini running home assistant with some kind of llama plugin running one if the 7B models should do well enough and would run entirely locally. It is just a

A mac mini running home assistant with some kind of llama plugin running one if the 7B models should do well enough and would run entirely locally. It is just a matter of time before someone builds it. I think one of the issues for a lot of people is the beefy hardware required for running even a 7B model locally. A RPi4 just won’t cut it for interactive use, and that’s what most people would run their home assistant setup on.