4 ms·

I had been thinking about doing this. I’m getting really tired of talking to Alexa now I’m used to a machine actually understanding me. Lights is just the sta

I had been thinking about doing this. I’m getting really tired of talking to Alexa now I’m used to a machine actually understanding me. Lights is just the start. Things like getting the weather, playing a playlist (or coming up with a new one for me) would all be SO much better with an LLM instead of a dumb bot. Edit: if you’re going to downvote. Leave a comment at least. Are there just a lot of Alexa fans in the house?

awwaiid 3y ago
Maybe you need to let your LLM manage Alexa
majormajor 3y ago
Coming up with a playlist is a fun one, but I've had much more luck with stuff like "generate a description of a playlist" - I have a little side project that talks to the spotify API and dumps song metadata into sqlite, and plugging GPT in as a SQL query generator was super useful vs writing all those queries by hand. Of course that requires a lot of up-front work other than GPT, but not a ton more than is necessary to talk to the API in the first place, but GPT itself has not impressed me in the ability to rank things, like "select the fifty other songs I've liked that are most like this song" even when given a lot of quantitative metadata.
gerdesj 3y ago
It's in its infancy but this does work - https://www.home-assistant.io/blog/2023/05/03/release-20235 https://www.home-assistant.io/blog/2023/05/03/release-20235 I have been able to turn a device on and off by speaking to the app on my phone. Nothing leaves my house. There is a bit of a lag but it is early days. You simply add the Piper and Whisper addons, then add the integration in the GUI. Then you press the assistant button in the app or your browser and then press the mic button and talk.
Corrado 3y ago
Agreed. In order to get Alexa to do some "higher order" stuff you have to be very explicit and program each step into a routine. This routine never changes or grows and barely adapts to the environment. For example, I have a routine called "breakfast" that turns on the TV and the light in the living room. Alexa doesn't really know anything about breakfast it just blindly turns on the light and TV. I think it would be handy to have Alexa know that I've been watching a particular show during "breakfast" and turn the TV to the next episode. It would also be super handy for Alexa to notice that it's my usual breakfast time, I've just gotten milk and cereal out of the cabinet, and I'm heading to the TV room. Instead, I have to utter the words "Alexa, breakfast" when I want it to get ready for me to start my day.

awwaiid 3y ago

Maybe you need to let your LLM manage Alexa

majormajor 3y ago

Coming up with a playlist is a fun one, but I've had much more luck with stuff like "generate a description of a playlist" - I have a little side project that talks to the spotify API and dumps song metadata into sqlite, and plugging GPT in as a SQL query generator was super useful vs writing all those queries by hand. Of course that requires a lot of up-front work other than GPT, but not a ton more than is necessary to talk to the API in the first place, but GPT itself has not impressed me in the ability to rank things, like "select the fifty other songs I've liked that are most like this song" even when given a lot of quantitative metadata.

gerdesj 3y ago

It's in its infancy but this does work - https://www.home-assistant.io/blog/2023/05/03/release-20235 https://www.home-assistant.io/blog/2023/05/03/release-20235 I have been able to turn a device on and off by speaking to the app on my phone. Nothing leaves my house. There is a bit of a lag but it is early days. You simply add the Piper and Whisper addons, then add the integration in the GUI. Then you press the assistant button in the app or your browser and then press the mic button and talk.

Corrado 3y ago

Agreed. In order to get Alexa to do some "higher order" stuff you have to be very explicit and program each step into a routine. This routine never changes or grows and barely adapts to the environment. For example, I have a routine called "breakfast" that turns on the TV and the light in the living room. Alexa doesn't really know anything about breakfast it just blindly turns on the light and TV. I think it would be handy to have Alexa know that I've been watching a particular show during "breakfast" and turn the TV to the next episode. It would also be super handy for Alexa to notice that it's my usual breakfast time, I've just gotten milk and cereal out of the cabinet, and I'm heading to the TV room. Instead, I have to utter the words "Alexa, breakfast" when I want it to get ready for me to start my day.