3 ms·
Theres a simple equation that I think is true: Time to integrate LLM into existing home assistant >= Time to build home assistant from scratch using LLM. They
by fdgsdfogijq 4y ago
Theres a simple equation that I think is true:
Time to integrate LLM into existing home assistant >= Time to build home assistant from scratch using LLM.
They lost it in a very simple way:
Research Scientists and Managers refusing to let their importance be impacted. Existing NLP paradigms preserved at all costs, conservative technical decision making. Building something that can be delivered in 4 months, as opposed to long term technical vision. The people running the important NLP orgs in Alexa have been there since alexa started. There is no fresh air, just constant pushing for feature upon feature. No room for bottom up innovation, road maps are built and then delegated to worker bee coders.
I have first hand knowledge, that in Alexa right now, there are year long+ initiatives to productionalize ML models that are completely obsolete compared to GPT-4. Models that are still being figured out, are already borderline worthless.
The only moat is the number of devices already in peoples homes. A startup armed with a ChatGPT model could take down alexa very quickly if they could distribute speakers to homes.
Lets not forget the panic and the existential crises of careers built on old NLP knowledge, in both academia and industry. It turns out the solution to NLP is just "scale". All of the complicated heuristics for getting old school NLP solutions to work will be thrown away
- rcpt 4y agoHow would GPT be useful for Alexa? I don't actually want to chat with the speaker I just want it to find my keys and set timers
- fdgsdfogijq 4y agoAlexa is a complicated rube goldberg machine of ML models. For instance, when asking, "play songs by michael jackson", it runs an entity resolution query to figure out who michael jackson is, and then retrieve his music. There are a ton of systems along the way to solve this. Tons of data pipelines, formatting, autiditing, rules based matching etc. But all of those brittle expensive systems can be replaced by a single LLM.
- pixl97 4y ago>I don't actually want to chat with the speaker I just want it to find my keys and set timers Not to be snarky, but do you expect it to read your mind? You have to communicate with it somehow. Now that you're using spoken language to communicate you need to actually decode the sounds into text, and then you need to decode the meaning and intent from those spoken words. I have never seen a computer system as good at figuring out intent from comment statements at the Chat/Bing GPTs. So yea, at least to me it seems very useful.
- deleted 4y ago[deleted]
- chazeon 4y agoI have a seen proper prompt translate commands into API calls. I imagine it’s doable even just with self hosted solutions like Home Assistant or homebridge.