6 ms·
I had preview access to this one for a few weeks. It's very good. I had one conversation that lasted a full hour while I was walking the dog, got some good brai
by simonw 4mo ago
I had preview access to this one for a few weeks. It's very good. I had one conversation that lasted a full hour while I was walking the dog, got some good brainstorming done against one of my projects.
The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier.
I did report a fun bug with it though: it was interrupting me and laughing at my (not really intended as) jokes while I was still talking! They seem to have clamped that behavior down thankfully, it felt a bit rude and condescending.
- heisgone 4mo agoIs it a dumb-down version of GPT like the current voice model? At least in french, I find the current GPT voice mode to be useless, to the point I only use the dication mode. I would ask a question and it would answer something along "That's a interesting question. I can help you with that. Anything you want to know about X?" I would ask again and it would answer the same kind of non answer.
- KaoruAoiShiho 4mo agoClick through to the link, the answer is no it uses the latest gpt models now.
- magicalist 4mo ago> the answer is no it uses the latest gpt models now. Actually it says it _can_ delegate to the latest models. Seems reasonable to ask how the voice model does when it doesn't delegate (or while waiting for the delegated answer).
- derefr 4mo agoI haven't stress-tested it, but I would imagine it approaches complex problems the same way a human with a phone in their pocket would — that is, by having a degree of awareness of the confidence it has in its own knowledge in some areas; where, when it "realizes that it doesn't know", it blocks the conversation with statements like "I don't know, let me check." I say this because this is already how ChatGPT works internally when using its "auto" mode; the version of the "fast" model used in the "auto" mode does the same "notice your ignorance and bring in the heavy model" thing, just silently, rather than mentioning that it's doing it. (If someone has actually run the experiment, please chime in!)
- athyuttamre 4mo agoThank you for testing and the feedback Simon!
- 100ms 4mo agoIs it responsive to personality settings? I actively don't want fake AI girlfriend, but I do get a ton of value out of voice mode. Looking forward to trying this but hoping it's not a creepy overdone mess (like Sesame). Expectations are they'll keep doubling down on fake AI girlfriend approach because the thing I want probably wouldn't drive engagement anywhere nearly as well
- Someone1234 4mo agoI too found this with their previous attempts. I have my Chat personality settings stripped right down to no-fluff. I'd want voice to be more akin to the Star Trek computer, and less akin to as you said an AI friend, but previously it was tuned too personable/friend-like.
- 100ms 4mo agoStar Trek computer voice model is something I have yet to encounter, and I've looked repeatedly :) It's not about a specific voice, it's the fact they managed to capture "I am a utility" perfectly in the voice. Our modern friends do not want to be thought of as a utility, but to engender trust and agency all of their own and that's a huge problem for me.
- purpleidea 4mo agoFor many years, I've wanted ED-209 (robocop) voice from something like espeak or similar. Still can't find anything good. Not for chat, just as a way to make notification messages that sound like ED-209.
- 100ms 4mo agoI think that's mostly just a frequency shift :) You could probably recreate it with another model and some effects on top. Also, why the hell not for voice mode haha.
- bitwize 4mo agoOne popular speech synth from back in the day, I believe it was WillowTalk, had a voice called Colossus, which sounded like the voice module of the computer from Colossus: The Forbin Project. This voice was used for that of CATS in the famous "All your base are belong to us" Flash video. Another WillowTalk voice was a clone of DECtalk's Perfect Paul good enough to be used as the voice in the MC Hawking rap recordings.
- FlamingMoe 4mo agoCool, was this conversation through the chatgpt app?
- simonw 4mo agoYes, ChatGPT on iPhone.
- dajonker 4mo agoBut does it generate good pelicans?
- trollbridge 4mo agoI had an enjoyable conversation with it just now where it repeatedly told me it had generated an SVG of a pelican riding a bicycle along with a clickable data: link. Obviously, this is just harness polish. Overall, it's quite impressive. Someday we'll have a tokeniser that works directly on human speech instead of doing speech-to-text and text-to-speech steps in between.
- mrits 4mo agoAbout 2 years ago I used to have conversations with GPT while walking the dog. It really emphasized the need to think before you speak, but you had to think fast before it hung up on you.
- lesinski 4mo ago[flagged]
- pseudosavant 4mo agoThat is a nice idea and all, but perhaps there are things our friends aren't good at talking about. Perhaps something that is very related to a work project? Or like when I go down the rabbit hole discussing quantum mechanics and astro physics with ChatGPT because none of my friends understand that at even my level, and I'm looking to learn more about it from someone/something that does know more than me. I'm looking forward to trying this out because I find that doing discovery on certain things feels more natural with voice. The previous voice chat was such a dumb GPT-4 era model that I resorted to using the dictate feature with GPT-5.5 and had it read the text response back to me.
- scottyah 4mo agoHave you compared it to grok in teslas?
- amarant 4mo agoWait, you can talk to Teslas now? How did I miss thiS? Can I get a red led bar and basically have a KITT?
- tough 4mo agothe cybertruck seems designed for this KITT fantasy of yours
- amarant 4mo agoDammit! I live in Europe and the cyber truck isn't even available here.. That said a huge pickup truck is about as far as you can get from a Camaro... Then again I'm not exactly David Hasslehoff myself either... Meh if it talks that's close enough!
- squidsoup 4mo ago> Dammit! I live in Europe and the cyber truck isn't even available here.. Europeans are notorious for their good taste.
- nunez 4mo agoYes! Hey Grok was shipped to all Ryzen-based Teslas a year ago, I think. I don't use it but those that have found it useful.
- jacobgold 4mo ago> "The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier." Wow. That's exactly what I hoped they would do. This issue has held me back from using ChatGPT's voice mode as much as I otherwise would have, because I also use it for brainstorming while commuting, exercising, etc., and don't want it to feel stuck in the past.
- alexellisuk 4mo agoFunnily enough - I built this (delegation) over the weekend with Fable for a local voice chat running 100% on local LLMs, Parakeet and Kokoro. I say "...ask the thinking model..." and that redirects it to Qwen 3.6 27B on vLLM. Can't claim originality though - it was inspired by Sesame - where their models will invoke a search, or check the weather etc, and make a vocalisation to keep you engaged. Turn taking is one of the hardest things to get right for the exact reasons mentioned - but does seem to be the way that Claude.ai's voice works - in a very obvious way. Anthropic + OpenAI both rug-pulled voices I liked and got used to and OpenAI really dumbed down their voices at the same time - Arbor went from Estuary English and almost "jack the lad" to some generic English accent. Claude had a Birmingham accent and said things like "shit", ending sentences like "So you're telling me that they asked for a 90% discount yeah?" - then it changed overnight to a mock Derbyshire accent with a dull tone. ChatGPT's voice also gaslights me for conventional opinions - "my Eastern European neighbour helped me lift a wardrobe upstairs - something you just can't ask your typical neighbour neighbour"... then you get a full on left-leaning lecture from the safety layers rather than a head nod or "what luck!" Claude + Sesame are nowhere near as overbearing. In both cases - from edgy and engaging to something that just didn't gel. The point of making my own assistant is that I can talk for as long as I want, episodic memory is personal and private, there's no "trust me bro, we're a big corporation" vibes. This was not my first attempt - when I had a bunch of Opus credit around Jan/Feb - I tried really hard and created something that was not good enough. What I have now, is working, and each session is training Claude/Codex on what to tune, and to fix. "Just had a convo - can you look into what happened?" And if it's one I don't mind sharing with the model - I'll say, "and what did you think of the questions I asked?" Sometimes it'll give a lovely commentary on how the model did. af_heart is probably the smoothest voice - but yes it's more like another commented - more "StarTrek" than "telesales assistant that pauses and laughs at your jokes". If you're on a similar path and want something full duplex - the go to solution is PersonaPlex from Nvidia based upon Moshi.
- jvdsf 4mo ago[flagged]
- jjulius 4mo agoI highly recommend simply enjoying the walk.
- IncreasePosts 4mo ago[flagged]
- croes 4mo agoIsn’t that a life advice?
- visarga 4mo agoThat's anti life-advice
- croes 4mo agoIt’s an anti life-advice life-advice
- IncreasePosts 4mo agoI viewed jjulius' post as a cry for help, therefore I don't consider it unsolicited.
- deleted 4mo ago[deleted]
- SequoiaHope 4mo agoSeems a bit knee jerk. I go on walks and bike rides all the time. A couple of times I’ve used voice mode and it’s been interesting. I could have listened to music or a podcast, listen to YouTube or just unplug. But every walk is different. If you’re uncomfortable with this new world, and I’m sure I am even as I participate, you could tell us more about that?
- sauwan 4mo agoI think you're missing the counterfactual. I now have two choices: 1) sit behind my desk and work, or 2) walk and talk something out. Before this model, the voice models were pretty dumb and annoying to work with. We'll see if this changes that.
- ben_w 4mo ago> I did report a fun bug with it though: it was interrupting me and laughing at my (not really intended as) jokes while I was still talking! They seem to have clamped that behavior down thankfully, it felt a bit rude and condescending. Some times I'm still amazed that AI "gets" humour much more effectively than the character of Data did before his emotion chip, e.g.: https://www.youtube.com/watch?v=G4VZ5kQIdV0 https://www.youtube.com/watch?v=G4VZ5kQIdV0 Other times I'm amazed in the opposite way, that the script writers cover basically the same talking points about the character as we have today about LLMs, e.g.: https://www.youtube.com/watch?v=GBJCYHwyZhw https://www.youtube.com/watch?v=GBJCYHwyZhw
- BeetleB 4mo agoI should give these voice models another try. I have friends who have brainstormed with an LLM (voice chat) for 10-30 minutes, and reported very positive experiences. When I speak to one - while I'm impressed at how far they've progressed - the LLM just doesn't talk like someone I'd want to discuss a technical problem with (the way I would with a human). (And my friends aren't even using a custom prompt - some of them are just talking to the default Gemini on their phone!)
- solarkraft 4mo agoI also love exploring ideas like this. The problem that made me stop using Gemini is that it would always try really hard against all my prompting to ask a stupid question at the end of its response that would completely derail my train of thought.
- solarkraft 4mo agoI love the UX of voice mode. I’ve always hated voice models. Gemini’s being particularly egregious (always ending in some deranged question, can not reliably be prompted away) prompted me to build my own client for my real harness that simply does STT -> model -> TTS (both being independently useful). I guess I see some value in a model responding quickly and with more nuance, but it’s not much. I can wait for it to finish. I’d much rather have it be actually useful. I’m not looking for a digital friend. The delegation feature lets me see some value in a voice model for orchestration type features. But in either case, I don’t really like (or understand why others would like) talking to a model with different features and quirks just because I’m using a different medium to communicate over.
- shostack 4mo agoI have built out something similar that let's me use my phone's hardware buttons to open an input stream with the mic for my Hermes agent over my matrix gateway and then has it play back with a local TTS model on my Pixel 10 Pro. But the Deepseek v4 flash model I am using through OpenRouter is killing me on latency. Any suggestions to improve that?
- weitendorf 4mo agoI’ve spent my time very similarly working on my own voice stack project, but having also seen how non-developers use AI or experience technology in general, I truly think they are better served with a different UX and product than what we have. In other words, if you’re building your own voice inference tooling you’re just about the polar opposite user demographic than the one that truly needs and will value this. You’re using voice as a medium of convenience doing what existing models are technically and practically “shaped” to be able to do, knowing how they work well enough that conversation is more like typing/prompting with your voice than a natural interface. I’m guilty of this myself but have you ever even paid for a voice/audio model or hardware? Compare that to the millions of people with an Alexa device in their home who buy products through it, or who prefer calling support to get a human over poring over technical documentation. They’re actually very close to finally getting a version of “Alexa” that lives up to its promise and I’m happy for them
- fy20 4mo agoDoes it have full access to your chat history, project files, etc? That's the biggest limitation I have with voice mode right now, if I ask it about something I chatted about before (even in the same conversation) it has zero recollection of it.
- simonw 4mo agoYou can start a chat in an existing session after pasting data into that session and it can then talk about that content. I haven't tried it with projects.
- ozten 4mo agoCool it sounds like they have improved. This the first time I tried back in the day voice chats were different and you could not get the transcript after the fact.
- themadhouseofel 4mo ago[dead]
- peab 4mo ago>The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier. Ahh, this makes sense. I was wondering when they would start doing this. I stopped using voice mode all together because it was frustrating talking to a dumb AI, when most of the time I discuss things with Opus 4.8 or gpt 5.5. I was working on a phone call agent recently, and thought about doing this. It makes sense
- jr3592 4mo agodoes it work in codex?
- grumbelbart2 4mo agoCan it in some way do some action based on the talk? For example, can it summarize the brainstorming into a text file, post it somewhere etc.?
- simonw 4mo agoAt the end of the session I stop the voice mode and then type into my phone "write this up as bulletin points".
- mrklol 4mo agoHow did you give it access to your projects? That’s something I never thought does work as the voice model has no access outside of its scope?
- simonw 4mo agoI didn't mean the "projects" feature. I described my projects to it, had it search for extra details and pasted relevant inflection into the session before starting the voice chat.