4 ms·

Wasn't really till seeing this home assistant demo they have (https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4 https://www.loom.com/share/18c4dbcf8db

by cfowles 18d ago

Wasn't really till seeing this home assistant demo they have (https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4 https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4) that the value really clicked for me. Seems really cool.

ramoz 18d ago
Guess I'm a bit less impressed seeing that for some of the more intelligent driven+action work -- splitting requests in the video -- they had to kick out to an anthropic model.
- kzsh 18d ago
  Haiku, to rewrite a sentence as two discreet commands. I agree that it was notable that they delegated to an existing LLM, but I don't think it detracts much from the value proposition (not yet proven) of their demo.
  - deleted 17d ago
    [deleted]
  - deleted 17d ago
    [deleted]
  - alpineman 17d ago
    Agreed but is it much easier to deal with if you need to have all of these sub processes integrated? How does one know when you need to reword a request? What if Anthropic then has a type error, then debugging that just got harder.
- cfowles 18d ago
  That's fair, but it highlights how this would actually be used. It doesn't really seem like a competitor to other models but instead a way to make these real systems more enjoyable to deal with.
- iamjs 14d ago
  I wonder if they could have accomplished this with spaCy
fgblanch 18d ago
This video makes a better job at explaining what it is about vs the marketing ones. Thanks for sharing.
VladVladikoff 17d ago
This is very cool. However I don’t really want to bounce all my home automation commands to the cloud. I hope there will be an open weights approach one day. I’ve spent a lot of time setting up my local only home automation system, it would suck if it didn’t work during an internet outage, and also there are obvious privacy problems.
- ramoz 17d ago
  GLiClass is performant, and its zero-shot classification scores are in the same ballpark as the Terra-level results Jev points to. https://github.com/knowledgator/gliclass https://github.com/knowledgator/gliclass
  - VladVladikoff 17d ago
    Thanks!
    - ramoz 17d ago
      Rereading some things and because there's no official benchmarks, I misspoke about the ballpark comparison., but the open model's still a useful foundation to work with
  - somepatriot 17d ago
    thanks, it's definetly relevant
- rattray 17d ago
  Open weight or even closed with a proprietary license, I'd definitely like to be able to run it locally for all sorts of physical world stuff.
- toasty228 17d ago
  How many connected devices do you have? How often do you add/remove some? I feel like this whole scenario could be solved by a very ugly switch case generated by deepseek for 0.02ct.
wg0 17d ago
That's good. Side note - just like most people don't need an intelligent personal assistant to manage and respond their emails and book their flights, most people also don't need smart homes. Century old toggle switches are more than enough in a 3 room apartment or 5 room house unless you have a mention.
- qingcharles 17d ago
  My primary beef with smart home (having tried it) is that every person that visits your home ends up confused about some element of it. A light switch that goes up and down is universally understood.
  - apexalpha 17d ago
    My smarthome has regular switches and wifi. There's no reason to not do both. Also a quick NFC sticker in each room taking you to a small HTML site containing settings (temp, ventilation, lights, shutters, setting a alarm by the lights) has been golden. No one wants to: download Shelly app + AC app + look for ventilation IR controller + figure out how casting works for the TV + figure out how to use the Shelly app to turn lights into an alarm. It's too much friction for little gain. But a quick tap? Great. But tapping your phone on a NFC sticker bringing all those controls together per room in stead of per category (all lights in Shelly app. Person in room #1 has no interests in the lights in room #4 at the same time.). IF you tap it while not on Wifi yet it just tells you to connect to Wifi. :-) One "all house" sticker next to the front door allows any last person leaving or first person entering to put the entire house in active / idle mode. Works wonders. And as soon as local AI is quick enough the stickers will be a microphone!
    - throwaway314155 17d ago
      That's clever and all - solid setup, good work. But I still think you either overestimate the average house guest or have particularly savvy/young house guests.
      - 17d ago
qingcharles 17d ago
That really helped figuring out what this thing does, thank you.
mcintyre1994 17d ago
That's a really nice demo and way more helpful than their website, thanks for sharing it!
BiteCode_dev 17d ago
Thanks, much clearer that way. The speaker is unusually eloquent and to the point for a very nerdy demo, they should put that on their home page.
deleted 17d ago
[deleted]
dominotw 17d ago
Its all fun and games till it turns on blender instead of shutting down garage door

by cfowles 18d ago

ramoz 18d ago

Guess I'm a bit less impressed seeing that for some of the more intelligent driven+action work -- splitting requests in the video -- they had to kick out to an anthropic model.

kzsh 18d ago
Haiku, to rewrite a sentence as two discreet commands. I agree that it was notable that they delegated to an existing LLM, but I don't think it detracts much from the value proposition (not yet proven) of their demo.
- deleted 17d ago
  [deleted]
- deleted 17d ago
  [deleted]
- alpineman 17d ago
  Agreed but is it much easier to deal with if you need to have all of these sub processes integrated? How does one know when you need to reword a request? What if Anthropic then has a type error, then debugging that just got harder.
cfowles 18d ago
That's fair, but it highlights how this would actually be used. It doesn't really seem like a competitor to other models but instead a way to make these real systems more enjoyable to deal with.
iamjs 14d ago
I wonder if they could have accomplished this with spaCy

fgblanch 18d ago

This video makes a better job at explaining what it is about vs the marketing ones. Thanks for sharing.

VladVladikoff 17d ago

This is very cool. However I don’t really want to bounce all my home automation commands to the cloud. I hope there will be an open weights approach one day. I’ve spent a lot of time setting up my local only home automation system, it would suck if it didn’t work during an internet outage, and also there are obvious privacy problems.

ramoz 17d ago
GLiClass is performant, and its zero-shot classification scores are in the same ballpark as the Terra-level results Jev points to. https://github.com/knowledgator/gliclass https://github.com/knowledgator/gliclass
- VladVladikoff 17d ago
  Thanks!
  - ramoz 17d ago
    Rereading some things and because there's no official benchmarks, I misspoke about the ballpark comparison., but the open model's still a useful foundation to work with
- somepatriot 17d ago
  thanks, it's definetly relevant
rattray 17d ago
Open weight or even closed with a proprietary license, I'd definitely like to be able to run it locally for all sorts of physical world stuff.
toasty228 17d ago
How many connected devices do you have? How often do you add/remove some? I feel like this whole scenario could be solved by a very ugly switch case generated by deepseek for 0.02ct.

wg0 17d ago

That's good. Side note - just like most people don't need an intelligent personal assistant to manage and respond their emails and book their flights, most people also don't need smart homes. Century old toggle switches are more than enough in a 3 room apartment or 5 room house unless you have a mention.

qingcharles 17d ago
My primary beef with smart home (having tried it) is that every person that visits your home ends up confused about some element of it. A light switch that goes up and down is universally understood.
- apexalpha 17d ago
  My smarthome has regular switches and wifi. There's no reason to not do both. Also a quick NFC sticker in each room taking you to a small HTML site containing settings (temp, ventilation, lights, shutters, setting a alarm by the lights) has been golden. No one wants to: download Shelly app + AC app + look for ventilation IR controller + figure out how casting works for the TV + figure out how to use the Shelly app to turn lights into an alarm. It's too much friction for little gain. But a quick tap? Great. But tapping your phone on a NFC sticker bringing all those controls together per room in stead of per category (all lights in Shelly app. Person in room #1 has no interests in the lights in room #4 at the same time.). IF you tap it while not on Wifi yet it just tells you to connect to Wifi. :-) One "all house" sticker next to the front door allows any last person leaving or first person entering to put the entire house in active / idle mode. Works wonders. And as soon as local AI is quick enough the stickers will be a microphone!
  - throwaway314155 17d ago
    That's clever and all - solid setup, good work. But I still think you either overestimate the average house guest or have particularly savvy/young house guests.
    - 17d ago

qingcharles 17d ago

That really helped figuring out what this thing does, thank you.

mcintyre1994 17d ago

That's a really nice demo and way more helpful than their website, thanks for sharing it!

BiteCode_dev 17d ago

Thanks, much clearer that way. The speaker is unusually eloquent and to the point for a very nerdy demo, they should put that on their home page.

deleted 17d ago

[deleted]

dominotw 17d ago

Its all fun and games till it turns on blender instead of shutting down garage door