14 ms·

ChatGPT with voice is now available to all free users

408 points by Jimmc414 3y ago

breadwinner 3y ago
You can ask questions in any language and it automatically detects the language! Tried it and it works amazingly well. It replies in English though.
- zenlikethat 3y ago
  Always replied in Portuguese for me if requested, with a weird English accent to be fair. It seems whisper will transcribe everything you say (translated if needed) into just one language, usually English, if you mix them. This is with GPT4 though.
- da39a3ee 3y ago
  It replies in the language it thinks follows from what you said. It may have detected that you're non-English languages sounded like an English speaker?
  - breadwinner 3y ago
    It understands more languages than it speaks, so no it does not always reply in the same language.
squigz 3y ago
Announced by the OpenAI account, and retweeted by Brockman https://twitter.com/OpenAI/status/1727065166188274145 https://twitter.com/OpenAI/status/1727065166188274145
- dang 3y ago
  Yes, let's keep our implosion drama separate from our product announcements shall we? Changed from https://twitter.com/gdb/status/1727067288740970877 https://twitter.com/gdb/status/1727067288740970877 above, plus I degregged the title. I'm sure he won't mind. (submitted title was "ChatGPT Voice for All Free Users Announced (By Greg Brockman)") Thanks!
dizzydes 3y ago
I’ll ask the obvious question - does this make it more likely they’re rejoining OAI?
- 15457345234 3y ago
  It's just a retweet. Probably just a reflex action.
- thecosas 3y ago
  I think it's just him acknowledging his team's (at least until very recently) likely months long efforts to have this ready to go live.
- deleted 3y ago
  [deleted]
SirMaster 3y ago
Does that example really work? It's suggesting to ask it where to order 195 pizzas from. Does it have access to active business records like that?
- cypherpunks01 3y ago
  They re-enabled browsing access, so I believe it has the ability to search Bing again now.
  - modeless 3y ago
    It seems much better now too. Before, it would do exactly one query and read one or two results and then give up. Yesterday I asked a question and it did several queries and read probably a dozen results before answering. And it correctly said that little information was available on the topic I asked about, which impressed me because I expect it to hallucinate in that situation instead.
- omneity 3y ago
  I'm working on making it possible to feed LLMs live data from websites. It is challenging because injecting webpages into LLM prompts directly has a mixed result, especially if there's a smidge of ambiguity or complexity in the webpage HTML, so part of my work is on automatic methods to economically prune, format and feed web data to LLM RAG pipelines. You can follow my progress on twitter if you're interested (I tweet about other things, don't expect LLM/Data stuff only :) https://twitter.com/omarkamali https://twitter.com/omarkamali https://twitter.com/themonitoro https://twitter.com/themonitoro
Tycho 3y ago
I enjoy using the voice mode to learn about subjects when I’m driving.
- 15457345234 3y ago
  Does it tell you the truth, or just stuff that sounds right?
  - da39a3ee 3y ago
    Have you not been using chatGPT for programming questions this year? The implied criticism you're making became out of date when GPT4 was released. Of course, it makes things up when you stretch it, but the utility is no longer in question. What did you think all the fuss has been about?
    - 15457345234 3y ago
      > Have you not been using chatGPT for programming questions this year? No, I'm a fighter pilot in EVE Online.
      - da39a3ee 3y ago
        Ok cool. It's very, very useful. Clearly the biggest technological development in my life, and I grew up before the Internet.
  - psiops 3y ago
    Yes
  - Tycho 3y ago
    Hasn't really been a problem. The way I use it is like "Explain this concept to me." "Give examples from the physical world and every day life." "Elaborate on that last example." "Give some examples from the domain of ___." "Tell me about the history of the concept and why it was necessary to invent it." "How does this concept relate to the concept of ___." So I'm trying to approach what I want to learn from many different angles and build context and intuition. Sort of like talking to a tireless grad student tutor. Errors would become more obvious due to contradiction. I've caught it making some mistakes but they were sort of trivial and I could see the spirit of what it was getting at. Plus, "truth" tends to "click."
atlasunshrugged 3y ago
I just tried it out and I have to say I am blown away. I've never been someone who likes the voice capabilities (tried Siri once or twice, hated it) for just about any service as I can type pretty quickly but this is intelligent enough that I can have an unstructured conversation and still get to the results I want quickly. Very impressive.
- smusamashah 3y ago
  I feel blown away and creeped out at the same time. It sounds so natural that's it's creepy. Only question I have now is that is audio being streamed or generated on device.
  - MillionOClock 3y ago
    I'm almost sure its streamed
    - qwertox 3y ago
      It is streamed. They also offer this as an API for developers [0]. I just wish they'd offer more languages as it currently is English only. It can speak German and Spanish, but with a very clear English accent, which makes it kind of funny and makes one think about why the accent sounds so real. [0] https://platform.openai.com/docs/guides/text-to-speech https://platform.openai.com/docs/guides/text-to-speech
      - gtirloni 3y ago
        The Brazilian Portuguese accent was hilarious when I tried it a month ago. We thought it was some kind of joke we didn't understand.
        guiambros 3y ago
        Just tried now, and it was pretty good. Some slight accent that I wasn't able to detect (Minas Gerais?). Similar / better than the artificial voice of other assistants in pt-br. I'm using Sky's voice, FWIW.
smusamashah 3y ago
Wow I just tried the app with voice and the quality is amazing. It felt creepy. It is not a person I was talking to but the response time and quality is so good and I can't help myself but think I am talking to a real person. It is eerie. Edit: Based on the response time, I don't understand where the audio is being generated, is it local?
lkozloff 3y ago
Interesting - this was actually a feature that got me to convert. I have some slight annoyances with how it handles natural pauses as I collect my thoughts and speak, but overall it's been great. I've had some interesting discussions and it's helped me structure some thoughts by asking questions and follow-ups, then summarizing our conversation... all while I'm on a walk. One fun thing I did with my family was have it do an interactive adventure story starring us. We had an adventure, and then used the built in DALL-E to generate images of scenes from our adventure.
- yeck 3y ago
  Oh, that's sounds like it could be a lot of fun. Thanks for sharing. I'll remember that for when my little one is a bit older :)
- brap 3y ago
  > I have some slight annoyances with how it handles natural pauses as I collect my thoughts and speak I hate this about all voice assistants. They force you to speak in an unnatural way. It seems like there’s nothing intelligent about when they decide to respond, it’s like they just wait for X milliseconds of silence instead of using the context of what’s being said like a human would. Sometimes it’s the opposite problem. You finish asking your question but you gotta wait for the assistant to pick it up whereas a human would understand that you’re finished talking based on what you said. It might seem small and unimportant but I really think it’s one of the main reasons why voice assistants feel so… artificial. That and long ass responses.
  - geoelectric 3y ago
    One of the very few things I like about Alexa is that it has an option for being more forgiving about stammers and pauses. It actually works pretty well. Maybe the same will make it into ChatGPT at some point.
  - snypher 3y ago
    >They force you to speak in an unnatural way. I think the same thing can happen when speaking to anyone with different societal/cultural factors than yours. We just become more accustomed to it over time and it's less noticed. I think if this GPT had a big green alien face then we would find speaking to it less strange, somehow.
ilaksh 3y ago
I am wondering if this is kind of like an enjoy it while OpenAI still exists thing. I assume there will be a MS ChatGPT if OpenAI folds though. Or just Bing.
- earth-adventure 3y ago
  Bing app already has gpt4 with voice input and voice output.
charlie0 3y ago
Will this be available on the browser version?
- redsh 3y ago
  callannie.ai has browser support, and video characters too
  - konart 3y ago
    What does this have to do with ChatGPT with voice? Also this Call Annie requires Google sign in.
    - 4ggr0 3y ago
      That person developed Call Annie, so it was probably just a way to plug their own solution :) https://news.ycombinator.com/item?id=38374582 https://news.ycombinator.com/item?id=38374582
coolandsmartrr 3y ago
I'm wondering which part of this link I should focus on: (1) ChatGPT Voice is now free for all users (2) Greg Brockman is retweeting an announcement from a company he left
- m463 3y ago
  Maybe it is Greg_Brockman_30T_fp16.gguf?
ancorevard 3y ago
Got to love the builders. Even the EA decels can't stop them.
ldbooth 3y ago
Seems like the service is down. Maybe this is the cause.
- 4ggr0 3y ago
  Still (or again) down for me, 11 hours later. Oops! Our systems are a bit busy at the moment, please take a break and try again soon.
deleted 3y ago
[deleted]
1f60c 3y ago
The reference to [OpenAI's] exact number of employees is interesting in context.
- AlexErrant 3y ago
  I laughed. It has indeed been a long night(s) for the team.
deleted 3y ago
[deleted]
jordanpg 3y ago
I just wish it was a little bit faster. When this reaches imperceptible levels of latency, the future will be here.
- redsh 3y ago
  callannie.ai is faster and has and video characters too
Mandelmus 3y ago
Can somebody who knows their stuff about voice synthesis explain to me why chatGPT sounds like it's speaking German with an American accent when I speak to it in German? It's really surprising how believably it sounds like a native American-speaker speaking excellent, just not accent-free, German. I would imagine that voice synthesis models would somehow be trained on data from native speakers, so why the accent?
- miki123211 3y ago
  The same thing happens with Polish, it's your typical Polish Chicago resident.
  - SV_BubbleTime 3y ago
    Can you make a compassion between polish / polish Chicago and any two US accents?
    - xcdzvyn 3y ago
      My immediate assumption was that Chicago has a high Polish population, not necessarily that it's any different from other Polish American ones. edit: It would appear so: > Chicago is a city sprawling with Polish culture, billing itself as the largest Polish city outside of Poland, with approximately 185,000 Polish speakers, making Polish the third most spoken language in Chicago.
- pizzafeelsright 3y ago
  I am going to guess that 99% of the source data, models, training, correction, verification is translated by Americans. Translating a language is difficult on top of regional dialects creates additional complications. If someone is talking long enough to me I can identify their birth State based upon their American accent. Every State has a different pronunciation of certain words which can leak location data. Guessing you're Californian, educated parents, about 34 years old. No siblings.
  - 3y ago
ademeure 3y ago
Am I the only one who doesn't like these specific voices? The quality is incredible, but they feel too cheery/enthusiastic/casual and it just gets annoying after a while. I made an iOS shortcut a while ago that uses Siri with the ChatGPT app (it has iOS shortcut bindings) and despite Siri being a useless pile of junk compared to this, I actually prefer Siri's voice to this in some ways, because it doesn't feel so over the top. Maybe this is partly because of different cultural expectations between the USA and Europe? Or maybe I'm just being too cynical and ChatGPT really is that happy talking with me!...
- janalsncm 3y ago
  I don’t care about the voices themselves but the speech recognition is borderline unusable sometimes. It interjects when it shouldn’t and will frequently hear things incorrectly. At one point it misinterpreted me mentioning “tai chi” as “I can’t breathe” and responded with advice about medical emergencies.
  - ademeure 3y ago
    Do you mean Siri's voice recognition? If so, 100% agreed. My iOS shortcut uses OpenAI's Whisper API for voice recognition, and Siri (English United Kingdom - Siri Voice 1) for text to speech. I really like dictating things sometimes, and Whisper is perfect for that (automatic paragraphs inside the model itself would be nice but not a big deal). If anyone is interested - the "Whisper speech recognition in iOS" part is based on this shortcut I found that you can easily use yourself on both iOS and MacOS (free except for the OpenAI API usage fees obviously): https://giacomomelzi.com/transcribe-audio-messages-iphone-ai/ https://giacomomelzi.com/transcribe-audio-messages-iphone-ai...
    - janalsncm 3y ago
      No, I mean the voice recognition in ChatGPT. > free except for the OpenAI API usage fees There are several versions of Whisper which have been distilled and can run locally, so I don’t see what advantage making API calls would be other than increased latency and decreased reliability and data security.
einpoklum 3y ago
ChatGPT - yet another mechanism to mine data from you.
whalesalad 3y ago
This is going to make me order a pizza tonight, fml.
gsharma 3y ago
I wonder why they launched it today, when it was supposed to be a week-off for all OAI employees and amidst whatever else is going on? One possibility is to capture Thanksgiving gatherings as a growth hack where people demo this to their families/friends and increase app downloads for OAI.
- reidjs 3y ago
  Another possibility is that people who build products don’t actually care about leadership drama as much as Twitter or HN
  - namocat 3y ago
    Almost all of the OpenAI team signed a letter saying they would resign if the board is not replaced, so safe to say that they do care about the leadership drama; perhaps more than the rest of us.
    - voiceblue 3y ago
      There was at least one OpenAI employee on Blind [0] saying that they (unclear who "they" is but presumably some other employees) pressured employees into signing and called him in the middle of the night to do it. I just googled it and found a thread as well [1]. [0] https://teamblind.com https://teamblind.com [1] https://www.teamblind.com/post/OpenAI-employees-did-you-sign-the-petition-out-of-fear-OU4uvcyt https://www.teamblind.com/post/OpenAI-employees-did-you-sign...
- luma 3y ago
  My theory is that it was nearing ready for release so they pushed it out to deflect some of the bad press over recent drama. I'd suspect the challenge with releasing something like this is about 2% "the code" and 98% scaling it out to everyone and making that not explode.
ryanSrich 3y ago
Is there a way to paste text into the mobile app and get the voice to read it? I can't for the life of me figure out how to do this. There's no text input shown while in the voice feature despite ChatGPT telling me to "just type what you want me to read"
- brandonp0 3y ago
  I'm not sure if there's a better way but I've typed out requests via text, and as part of the request I type "read the results to me when I ask for them" or something along those lines. Then I turn on the voice mode and make the request.
CSMastermind 3y ago
I wish I could talk to ChatGPT on the website. I end up using Microsoft Word's dictate feature and then copy pasting.
- deleted 3y ago
  [deleted]
esafak 3y ago
What is the privacy policy; how long are recordings retained, are they trained on, etc.?
- gtirloni 3y ago
  A chat is a chat is a chat. There is a setting in the app under data controls where you tell it not to use your charts for training.
  - xyst 3y ago
    The illusion of control. We check all of these boxes yet our data still continues to get sold
    - gtirloni 3y ago
      I don't disagree but I'm just stating what is available in the app. Voice or text, they treat chats as a single thing. I understand the downvotes for showing disapproval at OpenAI's policies (or big tech's), but I don't know what else could I say. Should I have just replied with a snarky comment saying "a-ha! you expect them to respect your privacy? pffff"
      - deleted 3y ago
        [deleted]
  - I_am_tiberius 3y ago
    The setting is only saved client side which is a very odd design decision. I guess they made it that way so that if you disable the flag at one point (yes, it's active by default), the change only effects future requests. This whole privacy situation with openai makes me really angry with Sam Altman, who seems not to care about that at all - this setting seems to be specifically designed to be privacy-disrespecting. It reminds me on the early days of facebook when they set all your profile information to be public, but openai is much worse, because the information you put into the prompt is likely much more sensitive.
12lkk2 3y ago
This voice is so horrible. Sounds nothing like a real human voice. This kind a voice generator would be OK for 2008, but not for 2023...
xyst 3y ago
Remember: If it’s free. You are the product.
- yieldcrv 3y ago
  hoeing for prompts
- safety1st 3y ago
  It's not free, though. There's a free tier, but the product is ChatGPT Plus, metered access to API/newer models, etc. Usually this truism is invoked in reference to advertising business models where the actual customer is advertisers, and you're just inventory so from cable TV to web search the business has usually been happy to take a shit in your mouth whenever it serves their advertisers. We will see how things pan out with ChatGPT as the interests of a ChatGPT Plus user likely align closely with the interests of someone on the free tier. Historically I think freemium business models tend to be kinder to their customers than advertising-based ones, or at the least, they simply lean on you until you upgrade to paying customer (if they do enshittify the free tier I think you would see an amazing conversion rate to ChatGPT Plus because the product is so good and unique).
- autoexec 3y ago
  Remember: Even for things you spend lots of money on, you are still the product.
  - quickthrower2 3y ago
    Late stage capitalism!
Solvency 3y ago
Refuses to work for me all day.
51Cards 3y ago
Where is this available? I have the app installed but I don't see a headphones button, just one that seems to record my voice and then attempts to transcribe it for submission (and fails every time). I'm on Android, App icon is the black ChatGPT logo on a white background. Thanks!
- iLoveOncall 3y ago
  It fails to transcribe due to an API outage at the moment but I imagine that's the correct button.
- kingofpandora 3y ago
  I had to click the pencil/edit button first.
- bradley13 3y ago
  For me, it didn't appear until a few hours later. Pending update, maybe? Closing and re-opening the app 2-3 times? No idea, but eventually the headphone icon did appear (bottom right, for me on Android).
  - 51Cards 3y ago
    Thanks! It was there this morning for me as well. Didn't even have to do an app update.
23B1 3y ago
Considering the API is currently broken, I low-key think it's time for me to find a new partner...
kuratkull 3y ago
So that's why ChatGPT has failed to load or work for the past few hours. No really, it's down right now.
Beijinger 3y ago
How can I use this without a computer like Alexa for conversations? Like an Android device with a smart speaker? I think there is an OpenAI app. Serious question.
- simonw 3y ago
  I've been using it on my iPhone for a few weeks. It works great with AirPods.
modeless 3y ago
It's possible to run a voice AI similar to this entirely locally on a normal gaming PC with a good GPU using open source AI models. I have a standalone demo I've been working on that you can try if you have a 12GB+ Nvidia GPU: https://apps.microsoft.com/detail/9NC624PBFGB7 https://apps.microsoft.com/detail/9NC624PBFGB7 It's still very much a demo and not as good as GPT-4, but it responds much faster. It's fun to play with and it shows the promise. Open models have been improving very quickly. It remains to be seen just how good they can get but personally I believe that better-than-GPT-4 models are going to run on a $1k gaming PC in just a few years. You will be able to have a coherent spoken conversation with your GPU. It's a new type of computing experience.
- amelius 3y ago
  What models/libraries is it based on?
  - modeless 3y ago
    Currently OpenHermes2-Mistral-7B (via exllama2), OpenAI Whisper (via faster_whisper), and StyleTTS2 (uses HF Transformers). All PyTorch-based. I will probably update to the OpenHermes vision model when Nous Research releases it, so it'll be able to see with the webcam or even read your screen and chat about what you're working on! I also need to update to Whisper-v3 or Distil-Whisper, and I need to update to a newer StyleTTS2. I also plan to add a Mandarin TTS and Qwen-7B bilingual LLM for a bilingual chatbot. The amount of movement in open AI (not to be confused with OpenAI) is difficult to keep up with. Of course I need to add better attribution for all this stuff, and a whole lot of other things, like a basic UI. Very much an MVP at the moment.
    - amelius 3y ago
      Thanks for such a detailed answer!
    - alchemist1e9 3y ago
      This is why I think the personal Jarvis for everyday use won’t eventually be in the cloud. It can already be done on local hw as you are demonstrating and cloud has big downsides around privacy and latency and reliability. Like you said it’s difficult to keep up with and to me it feels very much like open source stuff might win for inference.
daguava 3y ago
[dead]
Jayakumark 3y ago
What a coincidence, was just looking something similar for local models and stumbled up on this, his Repo seems full of TTS/STT projects.. https://github.com/KoljaB/LocalAIVoiceChat https://github.com/KoljaB/LocalAIVoiceChat
Kim_Bruning 3y ago
"it's been a long night [...] how many pizzas should I order for 778 people". Hits differently than it would have last week. :-/
mysterydip 3y ago
Hello [UserName], my name is Doctor Sbaitso. I am here to help you. Say whatever is in your mind freely, our conversation will be kept in strict confidence. Memory contents will be wiped off after you leave, So, tell me about your problems.
- owlninja 3y ago
  Wow! We had a random conversation at work a couple of years ago and my boss mentioned some other old "chat bot", and suddenly my Doctor Sbaitso memory came rushing back. Along with lots of memories of trying to pick my soundcard in DOS games.
- toomuchtodo 3y ago
  https://classicreload.com/dr-sbaitso.html https://classicreload.com/dr-sbaitso.html
andsoitis 3y ago
that is just... incredible. the intonation, the response.
nier 3y ago
App Store on iOS 17.1.1 in Europe has ChatGPT app version 1.2023.319 (14269) released three days ago. No sign of ChatGPT Voice. No headphone icon to be found. There’s also no «New Features» entry in Settings on the mobile app and so no way to opt into voice conversations as the blog article suggests. https://openai.com/blog/chatgpt-can-now-see-hear-and-speak https://openai.com/blog/chatgpt-can-now-see-hear-and-speak Edit: The headphone icon appeared on Nov 22, 2023 around 6am CET without an update to the app. There is no «New Features» entry in the Settings.
- chamoda 3y ago
  Anyone having trouble getting this working, just close the app and reopen.
  - konschubert 3y ago
    thank you!!!
realharo 3y ago
It says it doesn't work when you have chat history turned off - and thus data collection, which is combined into the same setting. Even on the paid version.
- tananaev 3y ago
  It's not because OpenAI wants to force people to enable history. It's just a technical limitation in the way it currently works.
charles_f 3y ago
I don't get why in the midst of llm craze, Amazon is ditching devs from Alexa. It seems like abandoning a product for which the right technology just got invented
- mattmaroon 3y ago
  Alexa is a great example of a business building a market leading product that a lot of people love and then just completely failing to do anything with it.
  - Loggias 3y ago
    [dead]
- chiragjn 3y ago
  They seem to have a similar concept: https://www.youtube.com/watch?v=UqS3NxJ2L_I https://www.youtube.com/watch?v=UqS3NxJ2L_I But I think very few think of Alexa as a personal assistant, most people are just happy playing music and toggling room lights.
- The_Colonel 3y ago
  Yes, this is the missing piece to make all those voice assistants actually ... assistants. Alexa is for me currently music player and nothing more because it's so Dumb. With ChatGPT, it would be a whole different device for me.
I_am_tiberius 3y ago
Let me guess, your voices are being used for training purposes. I miss discussions about what a privacy nightmare it is that all the information you share is forever owned by openai and can be used for training purposes - BY DEFAULT!
- 3cats-in-a-coat 3y ago
  Imagine being pissed that someone is hearing and learning from your voice as you’re having conversation together. The concepts of copyright and privacy we have come from a different world and they already made little sense in the 90s with the rise of the web and search. We think of them as absolute but they are a human invention. Arbitrary and specific to the zeitgeist it was born in. We need boundaries for sure. But what they are is unclear.
  - simoncion 3y ago
    > Imagine being pissed that someone is hearing and learning from your voice as you’re having conversation together. Hello. USian here, talking about things from a USian perspective! YMMV in other countries, visit your local dealership for more information, & etc, etc, etc. A multi-million (or multi-billion) dollar company who can * Store recordings all of my utterances forever * Use my recordings to make tons of money without ever sending me a cent * Share my recordings with "trusted business partners" for "contractually-agreed-upon [with their partners, not with me] purposes" whenever they feel like * In short, use those recordings that they've stored forever for any nearly any purpose they see fit to is not "someone" that I'm having a "conversation" with. When I have a conversation with someone, they have a human's capacity to remember and disseminate that information. People get worse and worse at remembering things as those things recede into the past. Even if someone remembers an event very clearly, it's also usually impossible for someone to perfectly relate that event to another. When a company records what I'm saying and feeds that recording into their perfect-copy-machines and the perfect-copy-machines of their "trusted business partners", that's an entirely different thing. Surely you see that?
    - 3cats-in-a-coat 3y ago
superultra 3y ago
I’ve been using this for several weeks now and it’s replaced podcasts for me. I’ll just pick a topic and then ask for a summary and then ask clarifying questions. Other times I’ll just goof off. In one chat, I’m rewriting the Star Wars sequels movie by movie with ChatGPT. I’ve realized that I’m built to learn socially, and ChatGPT never tires of my questions or gets annoyed. One interesting story. My 15 year old kid was talking to it about Percy Jackson, and as Gen Z is prone to do, was using the phrase “kind of” quite a bit. At some point in the conversation, ChatGPT started using “kind of” as well in the audio. I imagine the underlying prompt is “make sure your answers are clear to the user” and somehow it’s determining that “kind of” is a way to build clarity in that context, or the phrase is informing the token set. Unsure but it was a little unsettling. For my part I find the natural pauses and accentuations really helpful. It’ll slow down when it’s hitting an “important” or complicated bit of information, and just like with humans, the pause and change in tone are indicators.
- w-ll 3y ago
  Me, as a meat popsicle, can you explain to me how the phrase “kind of” is not common? I feel like “kind of” is kind of a common adjective phrase, right?
  - superultra 3y ago
    It is, kind of! I definitely use it frequently, but the quantity that my kids use it is at a whole other level. But it’s a colloquial phrase that I rarely, if ever, hear ChatGPT use in the audio presentation, but looking at the chat transcript, there’s definitely a point at which it begins to use “kind of” in multiple ways in its responses, and it wasn’t before.
    - sprobertson 3y ago
      A more blatant example: it will start responding in French if you start speaking to it in French. These things are pattern machines and it makes sense that it will pick up on the lingo they fed (just like we will)
  - 3y ago
TamaraHasey 3y ago
[dead]
deleted 3y ago
[deleted]
wanderingmind 3y ago
As an aside its a shame that ChatGPT doesn't work with LineageOS phones even with microg spoofing. I hope they fix this. Many hackers who can provide valuable feedback are unable to use it at the moment
abrookewood 3y ago
"Hey everybody! Look over here!"
fredliu 3y ago
Open source LLM generic frontend project such as bigAGI (https://github.com/enricoros/big-agi https://github.com/enricoros/big-agi) has been having this feature for many months now. The good news: it even works with open source and local LLMs.
yewenjie 3y ago
Is this available to API users?
bradley13 3y ago
I'm unconvinced. Just a brief experiment, but I find the voices grating. They are really well synthesized, but they sound like the classic well-trained call center agent: fake friendly. I think the dialect is part of it as well: identifiably US West coast, presumably SF-Bay. Something more neutral, say, mid-Atlantic would be preferable for non-USaians. I asked ChatGPT if it could change its dialect - it said yes, but sounded exactly the same anyway. Maybe you get used to it? Dunno, I'll try again, if I have a use case...
- InCityDreams 3y ago
  >I asked ChatGPT if it could change its dialect - it said yes, but sounded exactly the same anyway. Dialect, or accent?
  - bradley13 3y ago
    In English, I asked it to change to a Scottish "accent". It said sure, but nothing changed. In German, I asked it to change to the "dialect" spoken in the Wallis - I got a bunch if info in the dialect, but all still in high German. tl;dr: I tried both...
madmod 3y ago
I just used this to practice my Japanese and it was really helpful having a judgement free correction of my grammar. It definitely takes longer than English because it’s using more tokens but the feedback is very thorough. I wish I could make the pause before sending automatically a bit longer. (I know I can hold to do it manually but the automated send is nice.)
- yellow_lead 3y ago
  Does the audio go direct to chatgpt, or through a transcription model first? I could see it being a bit inaccurate if the transcription silently corrects my error.
- dgunay 3y ago
  I tried telling it to speak slowly but it just kept rattling off at full speed while saying things like "I understand. I'll slow down. How is this for you?" Etc An unfortunately absent bit of accessibility that would really help second language learners
pjerem 3y ago
One of the reason i don’t want openAI to die isn’t only the (impressive) power of GPT-4. Actually, it’s the mobile application. They should have opted for a boring PWA but instead they developed a nice native application with good UI/UX. I also appreciate that they created integrations with the Shortcuts app which allows you to do make very powerful things. I really hope they extends this because it’s text only for now but now with GPT4V and the new ability to generate files, you could do impressive things with shortcuts.
- lynx23 3y ago
  I wish I could use the mobile app on iOS. Getting a weird error when trying to login, something about date/time being wrong on my device. Since date/time is autosynced, it must be something else. I wonder why I have this tendency to hit on bugs that nobody else has...
  - pmx 3y ago
    Could there be a MITM on your connection? That could cause SSL errors that may be reported as "make sure your date and time are correct"
    - lynx23 3y ago
      That MITM would have needed to follow me around, since I tried in several networks. But nothing is ruled out so far. I wish the error was a bit more informative, since my date/time settings are clearly OK, so I am kinda stuck here.
crystaln 3y ago
I’ve been using this for a while now and will bring ChatGPT as an additional conversational partner when having discussions where we don’t know the topic that well. It’s wild. Very close to Star Trek land. I never thought I’d see this.
- osullip 3y ago
  It's what people said about Google! We went from debating a topic to Googling the answer and resolving a whole night's debate in seconds. And I will tell you that Google didn't always get it right. Often a tweak to the search term could get the wrong answer, but win the argument. There are three topics banned at my table. Religion, politics, AI, Sam Altman, punctuation and maths.
chucke1992 3y ago
Why do you need humans if you have ChatGPT? Online communities are echo chambers, imagine now talking to a bot all the time.
hiq 3y ago
I wish I could have the text output instead of getting a vocal answer. We all can read way faster than we can listen to speech, and I don't need a lot of the fluff I get from LLMs. But I guess that's what most users want? Something that's closer to a conversation with a human? But I don't care about being polite with an LLM, it feels like an anti-pattern because it's too much overhead. Ideally I would: * query by voice * get the response in text as soon as possible, maybe even as I'm still talking, with the LLMs correcting the response as I give more information, and without needing me to touch anything * follow up by voice, even before the response was finished, and without needing to press anything I hope we'll get there eventually!
- LeafItAlone 3y ago
  > We all can read way faster than we can listen to speech I can’t. At least not with reading every word. I can finish an audiobook much faster than reading the book on my own. And I also can’t pick up as much reading by myself. My preferred way of consuming is now reading while a screen reader or audiobook is played at 1.5x or faster speed. Much better retention because
  - toss1 3y ago
    Interesting, it's exactly the opposite for me. My understanding of voice is much lower than of reading, and much slower. I think the biggest factors are that reading is faster than words are typically spoken, yet I can also pause and dwell on sections I don't get the first time, so I really get it and then proceed. Obviously, brains work very differently, so there really is no one-size-fits-all solution; we need the varied methods.
  - hiq 3y ago
    > At least not with reading every word. That's the crux of the issue though, isn't it? I don't read words by reading single letters, and I don't think I read sentences by reading every single word either. That'd be the main reason why listening is slower than reading: the forced linearity. To be fair, my "all" was clearly an exaggeration, I'm sure there are people for whom this doesn't apply, but I'd still expect it to apply to 50%+ of the populations of countries where literacy is not a significant issue anymore.

408 points by Jimmc414 3y ago

You can ask questions in any language and it automatically detects the language! Tried it and it works amazingly well. It replies in English though.

zenlikethat 3y ago
Always replied in Portuguese for me if requested, with a weird English accent to be fair. It seems whisper will transcribe everything you say (translated if needed) into just one language, usually English, if you mix them. This is with GPT4 though.
da39a3ee 3y ago
It replies in the language it thinks follows from what you said. It may have detected that you're non-English languages sounded like an English speaker?
- breadwinner 3y ago
  It understands more languages than it speaks, so no it does not always reply in the same language.

squigz 3y ago

Announced by the OpenAI account, and retweeted by Brockman https://twitter.com/OpenAI/status/1727065166188274145 https://twitter.com/OpenAI/status/1727065166188274145

dang 3y ago
Yes, let's keep our implosion drama separate from our product announcements shall we? Changed from https://twitter.com/gdb/status/1727067288740970877 https://twitter.com/gdb/status/1727067288740970877 above, plus I degregged the title. I'm sure he won't mind. (submitted title was "ChatGPT Voice for All Free Users Announced (By Greg Brockman)") Thanks!

dizzydes 3y ago

I’ll ask the obvious question - does this make it more likely they’re rejoining OAI?

15457345234 3y ago
It's just a retweet. Probably just a reflex action.
thecosas 3y ago
I think it's just him acknowledging his team's (at least until very recently) likely months long efforts to have this ready to go live.
deleted 3y ago
[deleted]

SirMaster 3y ago

Does that example really work? It's suggesting to ask it where to order 195 pizzas from. Does it have access to active business records like that?

cypherpunks01 3y ago
They re-enabled browsing access, so I believe it has the ability to search Bing again now.
- modeless 3y ago
  It seems much better now too. Before, it would do exactly one query and read one or two results and then give up. Yesterday I asked a question and it did several queries and read probably a dozen results before answering. And it correctly said that little information was available on the topic I asked about, which impressed me because I expect it to hallucinate in that situation instead.
omneity 3y ago
I'm working on making it possible to feed LLMs live data from websites. It is challenging because injecting webpages into LLM prompts directly has a mixed result, especially if there's a smidge of ambiguity or complexity in the webpage HTML, so part of my work is on automatic methods to economically prune, format and feed web data to LLM RAG pipelines. You can follow my progress on twitter if you're interested (I tweet about other things, don't expect LLM/Data stuff only :) https://twitter.com/omarkamali https://twitter.com/omarkamali https://twitter.com/themonitoro https://twitter.com/themonitoro

Tycho 3y ago

I enjoy using the voice mode to learn about subjects when I’m driving.

15457345234 3y ago
Does it tell you the truth, or just stuff that sounds right?
- da39a3ee 3y ago
  Have you not been using chatGPT for programming questions this year? The implied criticism you're making became out of date when GPT4 was released. Of course, it makes things up when you stretch it, but the utility is no longer in question. What did you think all the fuss has been about?
  - 15457345234 3y ago
    > Have you not been using chatGPT for programming questions this year? No, I'm a fighter pilot in EVE Online.
    - da39a3ee 3y ago
      Ok cool. It's very, very useful. Clearly the biggest technological development in my life, and I grew up before the Internet.
- psiops 3y ago
  Yes
- Tycho 3y ago
  Hasn't really been a problem. The way I use it is like "Explain this concept to me." "Give examples from the physical world and every day life." "Elaborate on that last example." "Give some examples from the domain of ___." "Tell me about the history of the concept and why it was necessary to invent it." "How does this concept relate to the concept of ___." So I'm trying to approach what I want to learn from many different angles and build context and intuition. Sort of like talking to a tireless grad student tutor. Errors would become more obvious due to contradiction. I've caught it making some mistakes but they were sort of trivial and I could see the spirit of what it was getting at. Plus, "truth" tends to "click."

atlasunshrugged 3y ago

I just tried it out and I have to say I am blown away. I've never been someone who likes the voice capabilities (tried Siri once or twice, hated it) for just about any service as I can type pretty quickly but this is intelligent enough that I can have an unstructured conversation and still get to the results I want quickly. Very impressive.

smusamashah 3y ago
I feel blown away and creeped out at the same time. It sounds so natural that's it's creepy. Only question I have now is that is audio being streamed or generated on device.
- MillionOClock 3y ago
  I'm almost sure its streamed
  - qwertox 3y ago
    It is streamed. They also offer this as an API for developers [0]. I just wish they'd offer more languages as it currently is English only. It can speak German and Spanish, but with a very clear English accent, which makes it kind of funny and makes one think about why the accent sounds so real. [0] https://platform.openai.com/docs/guides/text-to-speech https://platform.openai.com/docs/guides/text-to-speech
    - gtirloni 3y ago
      The Brazilian Portuguese accent was hilarious when I tried it a month ago. We thought it was some kind of joke we didn't understand.
      - guiambros 3y ago
        Just tried now, and it was pretty good. Some slight accent that I wasn't able to detect (Minas Gerais?). Similar / better than the artificial voice of other assistants in pt-br. I'm using Sky's voice, FWIW.

smusamashah 3y ago

Wow I just tried the app with voice and the quality is amazing. It felt creepy. It is not a person I was talking to but the response time and quality is so good and I can't help myself but think I am talking to a real person. It is eerie. Edit: Based on the response time, I don't understand where the audio is being generated, is it local?

lkozloff 3y ago

Interesting - this was actually a feature that got me to convert. I have some slight annoyances with how it handles natural pauses as I collect my thoughts and speak, but overall it's been great. I've had some interesting discussions and it's helped me structure some thoughts by asking questions and follow-ups, then summarizing our conversation... all while I'm on a walk. One fun thing I did with my family was have it do an interactive adventure story starring us. We had an adventure, and then used the built in DALL-E to generate images of scenes from our adventure.

yeck 3y ago
Oh, that's sounds like it could be a lot of fun. Thanks for sharing. I'll remember that for when my little one is a bit older :)
brap 3y ago
> I have some slight annoyances with how it handles natural pauses as I collect my thoughts and speak I hate this about all voice assistants. They force you to speak in an unnatural way. It seems like there’s nothing intelligent about when they decide to respond, it’s like they just wait for X milliseconds of silence instead of using the context of what’s being said like a human would. Sometimes it’s the opposite problem. You finish asking your question but you gotta wait for the assistant to pick it up whereas a human would understand that you’re finished talking based on what you said. It might seem small and unimportant but I really think it’s one of the main reasons why voice assistants feel so… artificial. That and long ass responses.
- geoelectric 3y ago
  One of the very few things I like about Alexa is that it has an option for being more forgiving about stammers and pauses. It actually works pretty well. Maybe the same will make it into ChatGPT at some point.
- snypher 3y ago
  >They force you to speak in an unnatural way. I think the same thing can happen when speaking to anyone with different societal/cultural factors than yours. We just become more accustomed to it over time and it's less noticed. I think if this GPT had a big green alien face then we would find speaking to it less strange, somehow.

ilaksh 3y ago

I am wondering if this is kind of like an enjoy it while OpenAI still exists thing. I assume there will be a MS ChatGPT if OpenAI folds though. Or just Bing.

earth-adventure 3y ago
Bing app already has gpt4 with voice input and voice output.

charlie0 3y ago

Will this be available on the browser version?

redsh 3y ago
callannie.ai has browser support, and video characters too
- konart 3y ago
  What does this have to do with ChatGPT with voice? Also this Call Annie requires Google sign in.
  - 4ggr0 3y ago
    That person developed Call Annie, so it was probably just a way to plug their own solution :) https://news.ycombinator.com/item?id=38374582 https://news.ycombinator.com/item?id=38374582

coolandsmartrr 3y ago

I'm wondering which part of this link I should focus on: (1) ChatGPT Voice is now free for all users (2) Greg Brockman is retweeting an announcement from a company he left

m463 3y ago
Maybe it is Greg_Brockman_30T_fp16.gguf?

ancorevard 3y ago

Got to love the builders. Even the EA decels can't stop them.

ldbooth 3y ago

Seems like the service is down. Maybe this is the cause.

4ggr0 3y ago
Still (or again) down for me, 11 hours later. Oops! Our systems are a bit busy at the moment, please take a break and try again soon.

deleted 3y ago

[deleted]

1f60c 3y ago

The reference to [OpenAI's] exact number of employees is interesting in context.

AlexErrant 3y ago
I laughed. It has indeed been a long night(s) for the team.

deleted 3y ago

[deleted]

jordanpg 3y ago

I just wish it was a little bit faster. When this reaches imperceptible levels of latency, the future will be here.

redsh 3y ago
callannie.ai is faster and has and video characters too

Mandelmus 3y ago

Can somebody who knows their stuff about voice synthesis explain to me why chatGPT sounds like it's speaking German with an American accent when I speak to it in German? It's really surprising how believably it sounds like a native American-speaker speaking excellent, just not accent-free, German. I would imagine that voice synthesis models would somehow be trained on data from native speakers, so why the accent?

miki123211 3y ago
The same thing happens with Polish, it's your typical Polish Chicago resident.
- SV_BubbleTime 3y ago
  Can you make a compassion between polish / polish Chicago and any two US accents?
  - xcdzvyn 3y ago
    My immediate assumption was that Chicago has a high Polish population, not necessarily that it's any different from other Polish American ones. edit: It would appear so: > Chicago is a city sprawling with Polish culture, billing itself as the largest Polish city outside of Poland, with approximately 185,000 Polish speakers, making Polish the third most spoken language in Chicago.
pizzafeelsright 3y ago
I am going to guess that 99% of the source data, models, training, correction, verification is translated by Americans. Translating a language is difficult on top of regional dialects creates additional complications. If someone is talking long enough to me I can identify their birth State based upon their American accent. Every State has a different pronunciation of certain words which can leak location data. Guessing you're Californian, educated parents, about 34 years old. No siblings.
- 3y ago

ademeure 3y ago

Am I the only one who doesn't like these specific voices? The quality is incredible, but they feel too cheery/enthusiastic/casual and it just gets annoying after a while. I made an iOS shortcut a while ago that uses Siri with the ChatGPT app (it has iOS shortcut bindings) and despite Siri being a useless pile of junk compared to this, I actually prefer Siri's voice to this in some ways, because it doesn't feel so over the top. Maybe this is partly because of different cultural expectations between the USA and Europe? Or maybe I'm just being too cynical and ChatGPT really is that happy talking with me!...

janalsncm 3y ago
I don’t care about the voices themselves but the speech recognition is borderline unusable sometimes. It interjects when it shouldn’t and will frequently hear things incorrectly. At one point it misinterpreted me mentioning “tai chi” as “I can’t breathe” and responded with advice about medical emergencies.
- ademeure 3y ago
  Do you mean Siri's voice recognition? If so, 100% agreed. My iOS shortcut uses OpenAI's Whisper API for voice recognition, and Siri (English United Kingdom - Siri Voice 1) for text to speech. I really like dictating things sometimes, and Whisper is perfect for that (automatic paragraphs inside the model itself would be nice but not a big deal). If anyone is interested - the "Whisper speech recognition in iOS" part is based on this shortcut I found that you can easily use yourself on both iOS and MacOS (free except for the OpenAI API usage fees obviously): https://giacomomelzi.com/transcribe-audio-messages-iphone-ai/ https://giacomomelzi.com/transcribe-audio-messages-iphone-ai...
  - janalsncm 3y ago
    No, I mean the voice recognition in ChatGPT. > free except for the OpenAI API usage fees There are several versions of Whisper which have been distilled and can run locally, so I don’t see what advantage making API calls would be other than increased latency and decreased reliability and data security.

einpoklum 3y ago

ChatGPT - yet another mechanism to mine data from you.

whalesalad 3y ago

This is going to make me order a pizza tonight, fml.

gsharma 3y ago

I wonder why they launched it today, when it was supposed to be a week-off for all OAI employees and amidst whatever else is going on? One possibility is to capture Thanksgiving gatherings as a growth hack where people demo this to their families/friends and increase app downloads for OAI.

reidjs 3y ago
Another possibility is that people who build products don’t actually care about leadership drama as much as Twitter or HN
- namocat 3y ago
  Almost all of the OpenAI team signed a letter saying they would resign if the board is not replaced, so safe to say that they do care about the leadership drama; perhaps more than the rest of us.
  - voiceblue 3y ago
    There was at least one OpenAI employee on Blind [0] saying that they (unclear who "they" is but presumably some other employees) pressured employees into signing and called him in the middle of the night to do it. I just googled it and found a thread as well [1]. [0] https://teamblind.com https://teamblind.com [1] https://www.teamblind.com/post/OpenAI-employees-did-you-sign-the-petition-out-of-fear-OU4uvcyt https://www.teamblind.com/post/OpenAI-employees-did-you-sign...
luma 3y ago
My theory is that it was nearing ready for release so they pushed it out to deflect some of the bad press over recent drama. I'd suspect the challenge with releasing something like this is about 2% "the code" and 98% scaling it out to everyone and making that not explode.

ryanSrich 3y ago

Is there a way to paste text into the mobile app and get the voice to read it? I can't for the life of me figure out how to do this. There's no text input shown while in the voice feature despite ChatGPT telling me to "just type what you want me to read"

brandonp0 3y ago
I'm not sure if there's a better way but I've typed out requests via text, and as part of the request I type "read the results to me when I ask for them" or something along those lines. Then I turn on the voice mode and make the request.

CSMastermind 3y ago

I wish I could talk to ChatGPT on the website. I end up using Microsoft Word's dictate feature and then copy pasting.

deleted 3y ago
[deleted]

esafak 3y ago

What is the privacy policy; how long are recordings retained, are they trained on, etc.?

gtirloni 3y ago
A chat is a chat is a chat. There is a setting in the app under data controls where you tell it not to use your charts for training.
- xyst 3y ago
  The illusion of control. We check all of these boxes yet our data still continues to get sold
  - gtirloni 3y ago
    I don't disagree but I'm just stating what is available in the app. Voice or text, they treat chats as a single thing. I understand the downvotes for showing disapproval at OpenAI's policies (or big tech's), but I don't know what else could I say. Should I have just replied with a snarky comment saying "a-ha! you expect them to respect your privacy? pffff"
    - deleted 3y ago
      [deleted]
- I_am_tiberius 3y ago
  The setting is only saved client side which is a very odd design decision. I guess they made it that way so that if you disable the flag at one point (yes, it's active by default), the change only effects future requests. This whole privacy situation with openai makes me really angry with Sam Altman, who seems not to care about that at all - this setting seems to be specifically designed to be privacy-disrespecting. It reminds me on the early days of facebook when they set all your profile information to be public, but openai is much worse, because the information you put into the prompt is likely much more sensitive.

12lkk2 3y ago

This voice is so horrible. Sounds nothing like a real human voice. This kind a voice generator would be OK for 2008, but not for 2023...

xyst 3y ago

Remember: If it’s free. You are the product.

yieldcrv 3y ago
hoeing for prompts
safety1st 3y ago
It's not free, though. There's a free tier, but the product is ChatGPT Plus, metered access to API/newer models, etc. Usually this truism is invoked in reference to advertising business models where the actual customer is advertisers, and you're just inventory so from cable TV to web search the business has usually been happy to take a shit in your mouth whenever it serves their advertisers. We will see how things pan out with ChatGPT as the interests of a ChatGPT Plus user likely align closely with the interests of someone on the free tier. Historically I think freemium business models tend to be kinder to their customers than advertising-based ones, or at the least, they simply lean on you until you upgrade to paying customer (if they do enshittify the free tier I think you would see an amazing conversion rate to ChatGPT Plus because the product is so good and unique).
autoexec 3y ago
Remember: Even for things you spend lots of money on, you are still the product.
- quickthrower2 3y ago
  Late stage capitalism!

Solvency 3y ago

Refuses to work for me all day.

51Cards 3y ago

Where is this available? I have the app installed but I don't see a headphones button, just one that seems to record my voice and then attempts to transcribe it for submission (and fails every time). I'm on Android, App icon is the black ChatGPT logo on a white background. Thanks!

iLoveOncall 3y ago
It fails to transcribe due to an API outage at the moment but I imagine that's the correct button.
kingofpandora 3y ago
I had to click the pencil/edit button first.
bradley13 3y ago
For me, it didn't appear until a few hours later. Pending update, maybe? Closing and re-opening the app 2-3 times? No idea, but eventually the headphone icon did appear (bottom right, for me on Android).
- 51Cards 3y ago
  Thanks! It was there this morning for me as well. Didn't even have to do an app update.

23B1 3y ago

Considering the API is currently broken, I low-key think it's time for me to find a new partner...

kuratkull 3y ago

So that's why ChatGPT has failed to load or work for the past few hours. No really, it's down right now.

Beijinger 3y ago

How can I use this without a computer like Alexa for conversations? Like an Android device with a smart speaker? I think there is an OpenAI app. Serious question.

simonw 3y ago
I've been using it on my iPhone for a few weeks. It works great with AirPods.

modeless 3y ago

It's possible to run a voice AI similar to this entirely locally on a normal gaming PC with a good GPU using open source AI models. I have a standalone demo I've been working on that you can try if you have a 12GB+ Nvidia GPU: https://apps.microsoft.com/detail/9NC624PBFGB7 https://apps.microsoft.com/detail/9NC624PBFGB7 It's still very much a demo and not as good as GPT-4, but it responds much faster. It's fun to play with and it shows the promise. Open models have been improving very quickly. It remains to be seen just how good they can get but personally I believe that better-than-GPT-4 models are going to run on a $1k gaming PC in just a few years. You will be able to have a coherent spoken conversation with your GPU. It's a new type of computing experience.

amelius 3y ago
What models/libraries is it based on?
- modeless 3y ago
  Currently OpenHermes2-Mistral-7B (via exllama2), OpenAI Whisper (via faster_whisper), and StyleTTS2 (uses HF Transformers). All PyTorch-based. I will probably update to the OpenHermes vision model when Nous Research releases it, so it'll be able to see with the webcam or even read your screen and chat about what you're working on! I also need to update to Whisper-v3 or Distil-Whisper, and I need to update to a newer StyleTTS2. I also plan to add a Mandarin TTS and Qwen-7B bilingual LLM for a bilingual chatbot. The amount of movement in open AI (not to be confused with OpenAI) is difficult to keep up with. Of course I need to add better attribution for all this stuff, and a whole lot of other things, like a basic UI. Very much an MVP at the moment.
  - amelius 3y ago
    Thanks for such a detailed answer!
  - alchemist1e9 3y ago
    This is why I think the personal Jarvis for everyday use won’t eventually be in the cloud. It can already be done on local hw as you are demonstrating and cloud has big downsides around privacy and latency and reliability. Like you said it’s difficult to keep up with and to me it feels very much like open source stuff might win for inference.

daguava 3y ago

[dead]

Jayakumark 3y ago

What a coincidence, was just looking something similar for local models and stumbled up on this, his Repo seems full of TTS/STT projects.. https://github.com/KoljaB/LocalAIVoiceChat https://github.com/KoljaB/LocalAIVoiceChat

Kim_Bruning 3y ago

"it's been a long night [...] how many pizzas should I order for 778 people". Hits differently than it would have last week. :-/

mysterydip 3y ago

Hello [UserName], my name is Doctor Sbaitso. I am here to help you. Say whatever is in your mind freely, our conversation will be kept in strict confidence. Memory contents will be wiped off after you leave, So, tell me about your problems.

owlninja 3y ago
Wow! We had a random conversation at work a couple of years ago and my boss mentioned some other old "chat bot", and suddenly my Doctor Sbaitso memory came rushing back. Along with lots of memories of trying to pick my soundcard in DOS games.
toomuchtodo 3y ago
https://classicreload.com/dr-sbaitso.html https://classicreload.com/dr-sbaitso.html

andsoitis 3y ago

that is just... incredible. the intonation, the response.

nier 3y ago

App Store on iOS 17.1.1 in Europe has ChatGPT app version 1.2023.319 (14269) released three days ago. No sign of ChatGPT Voice. No headphone icon to be found. There’s also no «New Features» entry in Settings on the mobile app and so no way to opt into voice conversations as the blog article suggests. https://openai.com/blog/chatgpt-can-now-see-hear-and-speak https://openai.com/blog/chatgpt-can-now-see-hear-and-speak Edit: The headphone icon appeared on Nov 22, 2023 around 6am CET without an update to the app. There is no «New Features» entry in the Settings.

chamoda 3y ago
Anyone having trouble getting this working, just close the app and reopen.
- konschubert 3y ago
  thank you!!!

realharo 3y ago

It says it doesn't work when you have chat history turned off - and thus data collection, which is combined into the same setting. Even on the paid version.

tananaev 3y ago
It's not because OpenAI wants to force people to enable history. It's just a technical limitation in the way it currently works.

charles_f 3y ago

I don't get why in the midst of llm craze, Amazon is ditching devs from Alexa. It seems like abandoning a product for which the right technology just got invented

mattmaroon 3y ago
Alexa is a great example of a business building a market leading product that a lot of people love and then just completely failing to do anything with it.
- Loggias 3y ago
  [dead]
chiragjn 3y ago
They seem to have a similar concept: https://www.youtube.com/watch?v=UqS3NxJ2L_I https://www.youtube.com/watch?v=UqS3NxJ2L_I But I think very few think of Alexa as a personal assistant, most people are just happy playing music and toggling room lights.
The_Colonel 3y ago
Yes, this is the missing piece to make all those voice assistants actually ... assistants. Alexa is for me currently music player and nothing more because it's so Dumb. With ChatGPT, it would be a whole different device for me.

I_am_tiberius 3y ago

Let me guess, your voices are being used for training purposes. I miss discussions about what a privacy nightmare it is that all the information you share is forever owned by openai and can be used for training purposes - BY DEFAULT!

3cats-in-a-coat 3y ago
Imagine being pissed that someone is hearing and learning from your voice as you’re having conversation together. The concepts of copyright and privacy we have come from a different world and they already made little sense in the 90s with the rise of the web and search. We think of them as absolute but they are a human invention. Arbitrary and specific to the zeitgeist it was born in. We need boundaries for sure. But what they are is unclear.
- simoncion 3y ago
  > Imagine being pissed that someone is hearing and learning from your voice as you’re having conversation together. Hello. USian here, talking about things from a USian perspective! YMMV in other countries, visit your local dealership for more information, & etc, etc, etc. A multi-million (or multi-billion) dollar company who can * Store recordings all of my utterances forever * Use my recordings to make tons of money without ever sending me a cent * Share my recordings with "trusted business partners" for "contractually-agreed-upon [with their partners, not with me] purposes" whenever they feel like * In short, use those recordings that they've stored forever for any nearly any purpose they see fit to is not "someone" that I'm having a "conversation" with. When I have a conversation with someone, they have a human's capacity to remember and disseminate that information. People get worse and worse at remembering things as those things recede into the past. Even if someone remembers an event very clearly, it's also usually impossible for someone to perfectly relate that event to another. When a company records what I'm saying and feeds that recording into their perfect-copy-machines and the perfect-copy-machines of their "trusted business partners", that's an entirely different thing. Surely you see that?
  - 3cats-in-a-coat 3y ago

superultra 3y ago

I’ve been using this for several weeks now and it’s replaced podcasts for me. I’ll just pick a topic and then ask for a summary and then ask clarifying questions. Other times I’ll just goof off. In one chat, I’m rewriting the Star Wars sequels movie by movie with ChatGPT. I’ve realized that I’m built to learn socially, and ChatGPT never tires of my questions or gets annoyed. One interesting story. My 15 year old kid was talking to it about Percy Jackson, and as Gen Z is prone to do, was using the phrase “kind of” quite a bit. At some point in the conversation, ChatGPT started using “kind of” as well in the audio. I imagine the underlying prompt is “make sure your answers are clear to the user” and somehow it’s determining that “kind of” is a way to build clarity in that context, or the phrase is informing the token set. Unsure but it was a little unsettling. For my part I find the natural pauses and accentuations really helpful. It’ll slow down when it’s hitting an “important” or complicated bit of information, and just like with humans, the pause and change in tone are indicators.

w-ll 3y ago
Me, as a meat popsicle, can you explain to me how the phrase “kind of” is not common? I feel like “kind of” is kind of a common adjective phrase, right?
- superultra 3y ago
  It is, kind of! I definitely use it frequently, but the quantity that my kids use it is at a whole other level. But it’s a colloquial phrase that I rarely, if ever, hear ChatGPT use in the audio presentation, but looking at the chat transcript, there’s definitely a point at which it begins to use “kind of” in multiple ways in its responses, and it wasn’t before.
  - sprobertson 3y ago
    A more blatant example: it will start responding in French if you start speaking to it in French. These things are pattern machines and it makes sense that it will pick up on the lingo they fed (just like we will)
- 3y ago

TamaraHasey 3y ago

[dead]

deleted 3y ago

[deleted]

wanderingmind 3y ago

As an aside its a shame that ChatGPT doesn't work with LineageOS phones even with microg spoofing. I hope they fix this. Many hackers who can provide valuable feedback are unable to use it at the moment

abrookewood 3y ago

"Hey everybody! Look over here!"

fredliu 3y ago

Open source LLM generic frontend project such as bigAGI (https://github.com/enricoros/big-agi https://github.com/enricoros/big-agi) has been having this feature for many months now. The good news: it even works with open source and local LLMs.

yewenjie 3y ago

Is this available to API users?

bradley13 3y ago

I'm unconvinced. Just a brief experiment, but I find the voices grating. They are really well synthesized, but they sound like the classic well-trained call center agent: fake friendly. I think the dialect is part of it as well: identifiably US West coast, presumably SF-Bay. Something more neutral, say, mid-Atlantic would be preferable for non-USaians. I asked ChatGPT if it could change its dialect - it said yes, but sounded exactly the same anyway. Maybe you get used to it? Dunno, I'll try again, if I have a use case...

InCityDreams 3y ago
>I asked ChatGPT if it could change its dialect - it said yes, but sounded exactly the same anyway. Dialect, or accent?
- bradley13 3y ago
  In English, I asked it to change to a Scottish "accent". It said sure, but nothing changed. In German, I asked it to change to the "dialect" spoken in the Wallis - I got a bunch if info in the dialect, but all still in high German. tl;dr: I tried both...

madmod 3y ago

I just used this to practice my Japanese and it was really helpful having a judgement free correction of my grammar. It definitely takes longer than English because it’s using more tokens but the feedback is very thorough. I wish I could make the pause before sending automatically a bit longer. (I know I can hold to do it manually but the automated send is nice.)

yellow_lead 3y ago
Does the audio go direct to chatgpt, or through a transcription model first? I could see it being a bit inaccurate if the transcription silently corrects my error.
dgunay 3y ago
I tried telling it to speak slowly but it just kept rattling off at full speed while saying things like "I understand. I'll slow down. How is this for you?" Etc An unfortunately absent bit of accessibility that would really help second language learners

pjerem 3y ago

One of the reason i don’t want openAI to die isn’t only the (impressive) power of GPT-4. Actually, it’s the mobile application. They should have opted for a boring PWA but instead they developed a nice native application with good UI/UX. I also appreciate that they created integrations with the Shortcuts app which allows you to do make very powerful things. I really hope they extends this because it’s text only for now but now with GPT4V and the new ability to generate files, you could do impressive things with shortcuts.

lynx23 3y ago
I wish I could use the mobile app on iOS. Getting a weird error when trying to login, something about date/time being wrong on my device. Since date/time is autosynced, it must be something else. I wonder why I have this tendency to hit on bugs that nobody else has...
- pmx 3y ago
  Could there be a MITM on your connection? That could cause SSL errors that may be reported as "make sure your date and time are correct"
  - lynx23 3y ago
    That MITM would have needed to follow me around, since I tried in several networks. But nothing is ruled out so far. I wish the error was a bit more informative, since my date/time settings are clearly OK, so I am kinda stuck here.

crystaln 3y ago

I’ve been using this for a while now and will bring ChatGPT as an additional conversational partner when having discussions where we don’t know the topic that well. It’s wild. Very close to Star Trek land. I never thought I’d see this.

osullip 3y ago
It's what people said about Google! We went from debating a topic to Googling the answer and resolving a whole night's debate in seconds. And I will tell you that Google didn't always get it right. Often a tweak to the search term could get the wrong answer, but win the argument. There are three topics banned at my table. Religion, politics, AI, Sam Altman, punctuation and maths.

chucke1992 3y ago

Why do you need humans if you have ChatGPT? Online communities are echo chambers, imagine now talking to a bot all the time.

hiq 3y ago

I wish I could have the text output instead of getting a vocal answer. We all can read way faster than we can listen to speech, and I don't need a lot of the fluff I get from LLMs. But I guess that's what most users want? Something that's closer to a conversation with a human? But I don't care about being polite with an LLM, it feels like an anti-pattern because it's too much overhead. Ideally I would: * query by voice * get the response in text as soon as possible, maybe even as I'm still talking, with the LLMs correcting the response as I give more information, and without needing me to touch anything * follow up by voice, even before the response was finished, and without needing to press anything I hope we'll get there eventually!

LeafItAlone 3y ago
> We all can read way faster than we can listen to speech I can’t. At least not with reading every word. I can finish an audiobook much faster than reading the book on my own. And I also can’t pick up as much reading by myself. My preferred way of consuming is now reading while a screen reader or audiobook is played at 1.5x or faster speed. Much better retention because
- toss1 3y ago
  Interesting, it's exactly the opposite for me. My understanding of voice is much lower than of reading, and much slower. I think the biggest factors are that reading is faster than words are typically spoken, yet I can also pause and dwell on sections I don't get the first time, so I really get it and then proceed. Obviously, brains work very differently, so there really is no one-size-fits-all solution; we need the varied methods.
- hiq 3y ago
  > At least not with reading every word. That's the crux of the issue though, isn't it? I don't read words by reading single letters, and I don't think I read sentences by reading every single word either. That'd be the main reason why listening is slower than reading: the forced linearity. To be fair, my "all" was clearly an exaggeration, I'm sure there are people for whom this doesn't apply, but I'd still expect it to apply to 50%+ of the populations of countries where literacy is not a significant issue anymore.