Great article overall and agree with local models. If it is connected to the internet, then it is not secure, you cannot trust your data not to be slurped up so

Great article overall and agree with local models. If it is connected to the internet, then it is not secure, you cannot trust your data not to be slurped up somewhere. Threat models yada yada. I'm in love with how fast models like insanely fast whisper, ggml llama.cpp, Mixtral, YOLO v5 e.t.c have come along. I very much predict devices in 2024+ that have powerful energy efficient GPUs and do multimodal inference locally without any connection to the internet. I remember buying the first comma.ai pre-panding which was essentially a modded android LG phone driving the car. No connection to internet, a freaking mobile phone driving the car without any human input on the highway. That totally blew my mind. I'm awaiting Apple to release a version of Siri that runs totally offline. Smart phones are the perfect target.