3 ms·
do you think it's feasible to create a Gen AI version of Alexa completely locally? unsure what exactly you're trying to say.
by rohan_ 2y ago
do you think it's feasible to create a Gen AI version of Alexa completely locally? unsure what exactly you're trying to say.
- KetoManx64 2y agoHomeAssistant already does
- wkat4242 2y agoHmm yeah but it needs 30 seconds to give an answer. And that's with the LLM running on a GPU with HBM2 memory.
- bttrpll 2y agoyes. that was the original design actually. and it worked. latency was a bit much though.
- ben_w 2y agoIt's not "Gen"erative, but is still a Transformer, and is kinda OK: https://github.com/openai/whisper https://github.com/openai/whisper (I'm not too impressed with the error rate, but OTOH Alexa and Siri mishear me fairly often as well, so Whisper may be "good enough").
- throwawaymaths 2y agoits feasible. if you want to try yourself you can start with the april-asr package.
- cantrecallmypwd 2y agoThere are tools to make your own.