I don't think it makes any sense to be running custom LLMs on-hardware on these devices. They're too small and too low power to be doing so. It makes a ton of s

I don't think it makes any sense to be running custom LLMs on-hardware on these devices. They're too small and too low power to be doing so. It makes a ton of sense to hack their small, specialized hardware for speech-detection to forward that to your own servers, though, and I'd love to see that article.