4 ms·
I built/building a realtime voice+vision app called Sen, its currently live in beta and streams frames over webrtc. It's fast and smart, but Im super curious to
by Aeroi 1y ago
I built/building a realtime voice+vision app called Sen, its currently live in beta and streams frames over webrtc. It's fast and smart, but Im super curious to see how these models do as we get closer to the metal. I can see these running on-device in the future with super fast ttfb.
- keyle 1y agoDo you have a write up of the tech stack and setup? Or willing to give the gist here? I'd like to make a private Qwen or similar for my kids to prompt with a button and voice control. It doesn't need vision... Although eventually that'd be very cool. Siri just sucks. We might not be there yet...
- Aeroi 1y agoyeah i made a post on here, but the algo sent it to the gulag abyss. https://news.ycombinator.com/item?id=43926673 https://news.ycombinator.com/item?id=43926673
- keyle 1y agoThat's a good product site but it doesn't help me in anyway...
- Aeroi 1y agoI also ran across an interesting robot toy demo today that had voice built in. it was whimsical and seemed like it was aimed towards primary education and kids. Someone here might know the name.
- stavros 1y agoYou can use Ollama or LM Studio, both in API mode, to return the responses. I believe they offer audio support, but I'm not entirely sure. However, if you're looking for instruction following (like an agent), I've tried to implement my own agent and have lost faith. Even GPT-4.1 will regularly gaslight me that no, it definitely ran the tool call to add the event to my calendar, when it just didn't. I can't get any more adherence out of it.
- cloudking 1y agoCheck out https://livekit.io/ https://livekit.io/
- keyle 1y agoAll this lead to, is paying or using APIs and more paying. That's not what I was asking for.
- tomp 1y agoWe're definitely there, there's just no "ready-made" apps yet. But the technology is possible, go to e.g. vapi.ai to test it.