Sean-Der

4 ms·

31.
by Sean-Der 5mo ago
That is not the case. See get-realtime-translate[0 that's doing it as a trickle instead (not turn based). [0] https://developers.openai.com/api/docs/models/gpt-realtime-t...
32.
by Sean-Der 5mo ago
Responding to some technical points first, but then after that I do see a future that isn't WebRTC. I don't think it matches where WebTransport+WebCodecs etc is going though. > …but as a user, I would much rather wait an extra
33.
by Sean-Der 5mo ago
I believe Gemini is Websockets? I have the same experience with heavy/custom applications that try to roll their own media stuff. You run into issues around AudioContext and resumption etc... it's a PITA to have to handle all thos
34.
by Sean-Der 5mo ago
What platforms were you targeting that you found it painful! Sorry it was frustrating. I hope it’s getting better with education/more libraries. It’s also amazing how easy Codex etc… can burn through it now
35.
by Sean-Der 5mo ago
I am excited for VAD to go away. PersonaPlex totally seems like the future. However things like 'Call center helpline' turn based actually seems better! You don't want to be interrupted when giving information back and forth
36.
by Sean-Der 5mo ago
Thanks for reading it! You can't beat Websockets :) Especially since you have so much tooling/existing stuff that works with HTTP. I have been trying to get a website off the ground that does Datachannels + SQlite in the browser a
37.
by Sean-Der 5mo ago
Thanks for using it :) I think It’s a case of you improve what you own. The owners of WebRTC servers were aggressively improving their part. They don’t own the inference servers.
38.
by Sean-Der 5mo ago
Did you use libwebrtc on the backend? When you say `libwebrtc` is the only game in town are you talking about clients or servers? Even for clients you have things like libpeer that libwebrtc can't hit.
39.
by Sean-Der 5mo ago
Check out [0]. You can do 'Voice AI' on small/cheap hardware. It's the most fun you can have in the space ATM :) It's been a while, but posted a demo here [1] [0] https://github.com/pipecat-ai/p
40.
by Sean-Der 5mo ago
It doesn't today, but you could with sometime like this [0]. You can save/suspend all WebRTC state and bring it back with the next process. [0] https://github.com/pion/webrtc-zero-downtime-restart
41.
by Sean-Der 5mo ago
Very grateful that OpenAI published the article/publicized their usage of Pion[0] a library I work on. If you aren't familiar with WebRTC it's a super fun space. I work on a book WebRTC for the Curious [1] that details how it
42.
How OpenAI delivers low-latency voice AI at scale(openai.com)
510 points by Sean-Der 5mo ago|146 comments
43.
by Sean-Der 5mo ago
What USB Tuners do people like? I have a Hauppauge WinTV-dualHD Dual Tuner - 955D and I have to restart server every 3 days because it deadlocks. Do any alternatives to TvHeadEnd exist? I looked a bit and seems like it’s the best. So much c
44.
by Sean-Der 5mo ago
> use WebRTC and deploy selective forwarding units, which are going to be something custom Would you mind explaining more? If you are doing WHIP/WHEP you should be able to drop in Broadcast Box/MediaMTX etc... and switch out
45.
by Sean-Der 6mo ago
Huge fan of BigBlueButton! It’s been cool to watch the project go through multiple big tech changes and still keep going. Never give up! Free/Open Source software especially in schools is so important
46.
by Sean-Der 6mo ago
What language? Would love to help :) especially with AI Coding I think it would be a lot more accessible these days. ex_webrtc is super cool. They have a cool built-in dashboard/analytics flow. It is way more 'operations friendly&
47.
by Sean-Der 6mo ago
Yep exactly! After it starts you can slice in any media you want. You need to make sure you are sending the same codec that the remote expects, otherwise nothing else! You can do a different resolution, bitrate etc...
48.
by Sean-Der 6mo ago
Yea! * Do video playback out of the browser. You can render a subset of frames, use a different pipeline for decode etc... * Pull video from a different source. Join Google Meet on current computer, but stream from another host.
49.
by Sean-Der 6mo ago
Have you tried doing video + pipewire yet? I am also using v4l2loopback, but its annoying to juggle /dev/video* devices. I wanted to do video stuff in docker containers, and it would be amazing if I could do pipewire in each conta
50.
by Sean-Der 6mo ago
I can’t wait for https://w3c.github.io/webrtc-rtptransport/ when you talk about pulling vide out seems like the perfect fit. I ended up doing proxy because Google Meet doesn’t let me hook at any RTCPeerConnection APIs
51.
by Sean-Der 6mo ago
Oh yes! I will pull together a demo. With ‘media-send’ I can send it out to ffmpeg/GStreamer and that does all the heavy lifting
52.
by Sean-Der 6mo ago
Thanks :) No better feeling to work on something and hear it is novel! So many projects that I think will be useful miss the mark.
53.
by Sean-Der 6mo ago
I wrote this to make Reverse Engineering WebRTC services easier. Will also let you save/send arbitrary media from WebRTC sessions. The idea is you do all your auth/interaction in the browser, but then do all WebRTC in Go. So you h
54.
Show HN: Pion/handoff – Move WebRTC out of browser and into Go(github.com)
101 points by Sean-Der 6mo ago|17 comments
55.
by Sean-Der 6mo ago
SFU is nice because it gives everyone privacy. Neither you or ISP know who you are communicating with. Otherwise if everything is trusted I love that we can have conversations without depending on others over the internet :)
56.
by Sean-Der 6mo ago
What’s painful about running LiveKit? What would make running WebRTC server easier?
57.
by Sean-Der 7mo ago
The ecosystem around RTMP is bonkers. RTMP has SO many users for video (Twitch, YouTube etc...) yet you have librtmp which has so many forks. OBS has its own version in-tree.... Then at the same time you have people trying to add extensions
58.
by Sean-Der 7mo ago
That's exciting! When you were evaluating it everything about the protocol/APIs fits your needs? Just features/software need to be implemented?
59.
by Sean-Der 7mo ago
What was the WebRTC bug, would love to help! I saw at work that FireFox doesn't properly implement [0] I wanted to go fix after FFmpeg + WHEP. If you are still struggling with WebRTC problems would love to help. Pion has a Discord and
60.
by Sean-Der 7mo ago
I really thought that OBS + WebRTC would be a few months project. Ended up being way stickier than I expected. Most days I’m more excited for this space than Pion. It’s just more fun to make software for users vs businesses mostly doing AI

More ›