5 ms·
Show HN: OpenAI/reflect – Physical AI Assistant that illuminates your life
I have been working on making WebRTC + Embedded Devices easier for a few years. This is a hackathon project that pulled some of that together. I hope others build on it/it inspires them to play with hardware. I worked on it with two other people and I had a lot of fun with some of the ideas that came out of it.
* Extendable/hackable - I tried to keep the code as simple as possible so others can fork/modify easily.
* Communicate with light. With function calling it changes the light bulb, so it can match your mood or feelings.
* Populate info from clients you control. I wanted to experiment with having it guide you through yesterday/today.
* Phone as control. Setting up new devices can be frustrating. I liked that this didn't require any WiFi setup, it just routed everything through your phone. Also cool then that they device doesn't actually have any sensitive data on it.
- lagrange77 1y agoIs it my browser, or does the video in the readme not have sound?
- Sean-Der 1y agoNo sound! YouTube video in README does. I was tempted to put Erik Satie in the README video. Didn’t want to risk copyright issues
- Sean-Der 1y agoI also have been working with Daily on https://github.com/pipecat-ai/pipecat-esp32 https://github.com/pipecat-ai/pipecat-esp32 I see so much potential if I can make hardware hacking + WebRTC easy. Not just for AI assistants but security cameras + robotics. If anyone has questions/ideas/feedback here to help :)
- joshu 1y agowhat is Daily?
- Sean-Der 1y agohttps://www.daily.co/ https://www.daily.co/ You can use it to build lots of different real-time communication projects. Conferencing, Send your audio/video to GPU servers for AI, broadcasting and lots more. It’s a super fun space to be in
- su 1y agoAre there any cool demos that use daily I can explore?
- Sean-Der 1y agohttps://www.linkedin.com/posts/thorwebdev_esp32-webrtc-activity-7350924659623649281-XLVI https://www.linkedin.com/posts/thorwebdev_esp32-webrtc-activ... https://m.youtube.com/watch?v=HbO18Elw9WY https://m.youtube.com/watch?v=HbO18Elw9WY Are two that I know of. Try it out, if you hit any roadblocks @ me on pipecat discord and would love to help
- joshu 1y agothis is very relevant to my interests. currently building a robot teleoperation project. i will have to investigate further.
- baxtr 1y agoIf you want to know what this is about, here’s the video they provided: https://www.youtube.com/watch?v=G5OUnpPAyCg https://www.youtube.com/watch?v=G5OUnpPAyCg
- deleted 1y ago[deleted]
- TZubiri 1y agoI get that this is as-is, but I wonder if so many ultra-alpha products don't dilute the OpenAI brand and create redundancy in the product line. It feels like the opposite of Apple's well thought out planned product design and product line. Let's see if it pays out.
- jgalt212 1y agoThey're selling shares at a $500B valuation. The market is telling them everything they are doing is amazing.
- TZubiri 1y agoIs it possible to differentiate the feedback of the initial success of chatgpt from whatever came after it? It's possible those investments are just the oai owners selling their 2023 chatgpt success and its profit share.
- tuckerman 1y agoFor a developer platform having examples is useful as a starting point for new projects. Also, I’m not sure if it’s similar at OpenAI, but when I was at Google it was much easier to get approval to put an open source project under the Google GitHub org than my personal user.
- Sean-Der 1y agoThis is just a hackathon project. Not a product in any way. My primary work is on backend WebRTC servers. This was just an outlet/fun side thing to do client and embedded work. I love writing C and do microcontrollers. I just can’t seem to find a way to do it full time:(
- dasickis 1y agoWe could help you find a pathway there :)
- deleted 1y ago
- Telemakhos 1y agoSomewhere in here there's a joke about how many tokens it takes to turn on a lightbulb.
- throwup238 1y agoIt deserves a minor rewrite of the Black Mirror episode Fifteen Million Merits where people do menial labor like folding laundry and washing dishes to earn tokens so that their LLM will dispense their toothpaste and send Studio Ghibli stylized birthday cards to their friends.
- mrbungie 1y agoinb4: When sama and co talk about UBI, they mean a variation of it based around a memecoin tethered/indexed on (tik)tokens.
- toomuchtodo 1y agohttps://en.wikipedia.org/wiki/World_(blockchain) https://en.wikipedia.org/wiki/World_(blockchain)
- a2128 1y agoProbably 1,000 for the system prompt, 400 for the audio speech-to-text, 8 for the query, 180 for the thinking, 12 for the tool call, 33 for the response with a useless follow-up question
- godelski 1y agoAll to achieve something that could be done with a Raspberry Pi. You could do all this locally too. https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86d8a64 https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86... https://www.xda-developers.com/ollama-ai-comparison-raspberry-pi-5/ https://www.xda-developers.com/ollama-ai-comparison-raspberr... https://www.xda-developers.com/raspberry-pi-voice-assistant-how/ https://www.xda-developers.com/raspberry-pi-voice-assistant-... https://www.youtube.com/watch?v=o1sN1lB76EA https://www.youtube.com/watch?v=o1sN1lB76EA
- voxelizer 1y agoI love seeing that hackathons are encouraged inside OpenAI and most importantly, that their outcome is also shared :)
- tesch1 1y agoA cynic might wonder if this is just another way for a corporation selling advertising to get more of the "your data". Who is sharing more? :)
- orliesaurus 1y agoPhilips Hue is about to start a riot
- kelseydh 1y agoIt annoys me a lot that the current devices for controlling smart homes, such as Amazon Alexa or Google Home, lack the ability for lovely conversations the way OpenAI has.
- godelski 1y agoI honestly can't tell if this comment is joking, serious, or AI lol
- HPsquared 1y agoLLMs have a lot of advantages over humans for making conversation. Even forgetting the main advantages (24x7 availability, and ability to talk about basically any topic for as much or little time as you want), they also get basically every obscure reference/analogy/metaphor and how it ties in to the topic at hand. Usually when you're talking to another person, the intersection of obscure references you can confidently make (with the assumption your partner will understand them) is much more limited. I enjoy making those random connections so it's a real luxury to have a conversation partner that gets them all. Another one is simply the time and attention they can bring to things a normal person would never have the time for. I'd not want to talk someone's ear off, unless I was paying them and even then, I don't want to subject someone to topics of only interest to myself. (Edit: I suppose it's the final apotheosis of the atomised individual leaving all traces of community behind)
- igleria 1y ago> LLMs have a lot of advantages over humans for making conversation. A lot of those advantages seem to be what enables an LLM to keep pushing people into delusion or triggering latent mental issues : https://www.psychologytoday.com/ie/blog/urban-survival/202507/the-emerging-problem-of-ai-psychosis https://www.psychologytoday.com/ie/blog/urban-survival/20250...
- HPsquared 1y agoOf course, every technology comes with risks.
- Unirely01 1y ago[dead]
- OJFord 1y agoWhy does this need hardware, other than the phone? Could just be an app on the phone couldn't it?
- Sean-Der 1y agoI was interested in the ‘hands-free’ idea. If I put these devices through out my house it would allow me to switch AI personalities by proximity. You can also use the device without your phone. These devices are also very cheap. I think you could do audio only for around ~5$
- countfeng 1y agoIt would be perfect if it could intelligently linkany device under authorization
- Sean-Der 1y agoCan you describe more? I would love to build/try it!