3 ms·
Really there needs to be a product based off of LLMs similar to Alexa or Google home where instead of connecting to the cloud it’s a locally run LLM. I don’t kn
by ninetyninenine 2y ago
Really there needs to be a product based off of LLMs similar to Alexa or Google home where instead of connecting to the cloud it’s a locally run LLM. I don’t know why one doesn’t exist yet or why no one is working on this
- fabiensanglard 2y ago> locally run LLM You mean like Ollama + llamacpp ?
- ninetyninenine 2y agoYeah but packaged into a singular smart speaker product. We know there’s a market out there for Alexa and Google home. So this would be the next generation of that. It’s the nobrainer next step.
- unshavedyak 2y agoWouldn't it be due to price? Quality LLMs are expensive, so the real question is can you make a product cheap enough to still have margins and a useful enough LLM that people would buy?
- johntash 2y agoYou can kind of get there with home assistant. I'm not sure if it can use tools yet, but you can expose stuff you'd ask about like the weather/etc.
- ninetyninenine 2y agoI have both and the one offered is really weak. If you pay you can use Gemini but it doesn’t have agentic access to smart home controls meaning you can no longer ask it to turn on or off the lights