Maybe of interest, I built and open-sourced a similar (web-based) end-to-end voice project last year for an AMD Hackathon: https://github.com/lhl/voicechat2 htt

Maybe of interest, I built and open-sourced a similar (web-based) end-to-end voice project last year for an AMD Hackathon: https://github.com/lhl/voicechat2 https://github.com/lhl/voicechat2 As a submission for an AMD Hackathon, one big thing is that I tested all the components to work with RDNA3 cards. It's built to allow for swappable components for the SRT, LLM, TTS (the tricky stuff was making websockets work and doing some sentence-based interleaving to lower latency). Here's a full write up on the project: https://www.hackster.io/lhl/voicechat2-local-ai-voice-chat-4c48f2 https://www.hackster.io/lhl/voicechat2-local-ai-voice-chat-4... (I've don't really have time to maintain that project, but it can be a good starting point for anyone that's looking to hack their own thing together.)