17 ms·
Apple previews Live Speech, Personal Voice, and more new accessibility features
- Alifatisk 4y agoDidn’t apple work on their own search engine? What happened to that?
- CharlesW 4y agoIt's not unusual for Apple to build the pieces it needs for "moonshot" efforts (e.g. a search engine good enough to replace Google) over the course of many years. Apple likely started thinking about this over a decade ago, and you can see precursors in things like Siri suggestions and search, App Store and Apple Music search, Apple Photos search, etc.
- robin_reala 4y agoThe Personal Voice feature is making me tear up. Pretty much the most human use of AI I’ve seen so far.
- nohaydeprobleme 4y agoFor ease of reading for other users, here is a quote from the article about the Personal Voice feature: "For users at risk of losing their ability to speak — such as those with a recent diagnosis of ALS (amyotrophic lateral sclerosis) or other conditions that can progressively impact speaking ability — Personal Voice is a simple and secure way to create a voice that sounds like them. "Users can create a Personal Voice by reading along with a randomized set of text prompts to record 15 minutes of audio on iPhone or iPad. This speech accessibility feature uses on-device machine learning to keep users’ information private and secure, and integrates seamlessly with Live Speech so users can speak with their Personal Voice when connecting with loved ones. “At the end of the day, the most important thing is being able to communicate with friends and family,” said Philip Green, board member and ALS advocate at the Team Gleason nonprofit, who has experienced significant changes to his voice since receiving his ALS diagnosis in 2018. “If you can tell them you love them, in a voice that sounds like you, it makes all the difference in the world — and being able to create your synthetic voice on your iPhone in just 15 minutes is extraordinary.”
- sork_hn 4y agoI wonder if I could use this to build a AI voice for my aging parents so I can hear their voices after they pass away?
- garblegarble 4y agoYou could also just record some conversations with them? I think hearing them actually speak about their experiences and memories would be much more impactful than hearing a simulation of them, no matter how accurate
- MagicMoonlight 4y agoYou can’t but that’s something that is doable in general. If you get enough decent audio of them you could do it.
- heywhatupboys 4y agoDo the diseased get to loose their voice when they are gone?
- sswezey 4y agoHonestly, I wish this was around 10 years ago to save my late mother's voice. I saved all my voicemails I have from her and wish I could hear more from her.
- 5350-uiop-1130 4y agoI̶ ̶p̶u̶t̶ ̶a̶ ̶w̶h̶i̶t̶e̶ ̶w̶a̶l̶l̶p̶a̶p̶e̶r̶ ̶o̶n̶ ̶t̶h̶e̶ ̶i̶P̶a̶d̶ ̶b̶e̶c̶a̶u̶s̶e̶ ̶o̶f̶ ̶m̶y̶ ̶a̶s̶t̶i̶g̶m̶a̶t̶i̶s̶m̶,̶ ̶a̶n̶d̶ ̶t̶h̶e̶ ̶c̶l̶o̶c̶k̶ ̶i̶s̶ ̶i̶n̶v̶i̶s̶i̶b̶l̶e̶ ̶b̶e̶c̶a̶u̶s̶e̶ ̶t̶h̶e̶ ̶c̶o̶l̶o̶u̶r̶s̶ ̶d̶o̶n̶t̶ ̶i̶n̶v̶e̶r̶s̶e̶ ̶l̶i̶k̶e̶ ̶A̶n̶d̶r̶o̶i̶d̶. The icons and toolbar items do not scale up to respect my accessibility display/font settings. even windows 10 allows me fine grained control over all UI sizing elements. but Apple apparently has other priorities.
- FredPret 4y agoDoes Invert Colors not work for you? Settings -> Accessibility -> Display & Text Size -> Classic Invert or Smart Invert
- deleted 4y ago[deleted]
- 5350-uiop-1130 4y agoI will try thanks
- knolan 4y agoI’ve just set a white wallpaper on my iPad and the clock and date are displayed as block on white. On my dark wallpaper the clock and date are displayed inverted as white. This works with dark or light mode also with background dimming on or off.
- easton 4y agoFinally! Grandma mode! With how hard it is to find uncomplicated dumbphones that work on AT&T, this will be an alternative for if we need to get my grandma another phone.
- ChicagoBoy11 4y agothis was my first thought as well. I could immediately see how this would totally allow my grandmother to be independent while using a smartphone!
- KyeRussell 4y agoMy first thought was “I’m totally going to turn this on on an off day”.
- usernew 4y agoif you want Grandma mode, have you considered getting her an iPhone? Literally Any old iphone will do.
- aaronbrethorst 4y agoFrankly, I think Assistive Access could be great for a lot of boomer parents/grandparents. My dad is unwilling to learn how to use a smartphone and this could be sufficiently approachable to let him overcome his fear of it.
- bigdict 4y ago"Assistive Access distills experiences across the Camera, Photos, Music, Calls, and Messages apps on iPhone to their essential features in order to lighten their cognitive load for users." I might use this myself even though I'm not disabled.
- xattt 4y ago> I might use this myself even though I'm not disabled. Also see curb cuts (1) (1) https://99percentinvisible.org/episode/curb-cuts/ https://99percentinvisible.org/episode/curb-cuts/
- teddyh 4y agohttps://en.wikipedia.org/w/index.php?title=Curb_cut_effect&oldid=1151107972 https://en.wikipedia.org/w/index.php?title=Curb_cut_effect&o...
- sparsevector 4y agoAgreed. Presenting this feature solely as a tool for users with cognitive disabilities might undersell its potential. There's a significant number of smartphone users who only utilize a small fraction of the available features and would prefer a simpler interface focusing on the 10% of features they actually use. Interestingly, this demographic includes both less tech-literate users, who might feel overwhelmed by the complexity, and extremely tech-literate users who know exactly what they need and prefer clean, distraction-free tools.
- Corrado 4y agoMy 84 year old mother does remarkably well with her suite of Apple products. However, it would be nice to simplify some things. She only calls or chats with a limited number of people. Reworking the phone and messenger apps to use large pictures of the people would be a benefit. Something similar for the camera / photos app would be great as well.
- 4y ago
- zackkatz 4y agoa) These features are truly moving. I didn’t expect to get emotional from a press release. b) It’s gonna be a bonkers keynote if they’re releasing this before WWDC.
- classified 4y agoI'd like to see text-to-speech applicable to iBooks so you can have whole chapters read to you. Not as good as an audio book, but better than nothing.
- robin_reala 4y agoSo I agree that easily available speech controls would be a nice benefit, but Books is fully compatible with VoiceOver already (and has been since VoiceOver’s launch).
- layer8 4y agoThis is problematic because it competes with audiobooks. Presumably Apple wants to sell audiobooks and also doesn’t want to piss off publishers. Kindle provides a (mediocre) text-to-speech feature, but only for books where publisher have consented to it. Apple’s strategy seems to be to have publishers (rather than readers) use their AI-powered digital narration service: https://authors.apple.com/support/4519-digital-narration-audiobooks https://authors.apple.com/support/4519-digital-narration-aud...
- felipemesquita 4y agoThe main issue I see older people have with iPhones is unrelated to ui complexity. iOS’ worst parts are services/updates where the user is frequently asked for Apple ID passwords and shown confusing ads for Apple services like iCloud Photo Library that end up making photos more complicated to use as some pictures are now unavailable without internet. More parts of the iOS experience are getting unnecessarily tangled with server side services that require unpredictable prompts to get acceptance to terms and conditions, logins, and traps that make you set up two factor auth or buy an unnecessary subscription.
- ec109685 4y agoI agree that apple prompts for iCloud passwords way too frequently and doesn’t have the ability to authorize with another device (despite the fact that you could reset your password from another device). “Type your password to buy this item on the App Store”. Why?
- falcolas 4y ago> “Type your password to buy this item on the App Store”. Why? Because store items can be quite expensive (particularly the microtransactions), and it's using a stored credit card. I too get bugged by the plethora of prompts, but this is a good example of when to use one. Plus, after doing it once you can tie it back to Face ID or Touch ID and not have to enter it again for quite some time.
- ec109685 4y agoStore items have much, much less value than your personal data on the device and that can be accessed just with your passcode.
- falcolas 4y agoFinancial transactions are held to a higher standard (i.e. there's a bunch of laws around them) than device access. That said, you can make your device passcode as complex as your Apple ID password if it's a tradeoff you're willing to make.
- rado 4y agoThis is great, though they should really fix accessibility basics: keyboard control in App Store etc. I contacted Apple Support about keyboard control of the Look Around feature in Maps, not sure they even understood the request. Directed me to an unsolicited ideas disclaimer.
- samwillis 4y agoFirstly compliments to Apple for all these incredible accessibility features. I think there is an important little nod to the future in this announcement. "Personal Voice" is training (likely fine tuning) and then running a local AI model to generate the user's voice. This is a sneak peak of the future of Apple. They are in the unique position to enable local AI tools, such as assistance or text generation, without the difficulties and privacy concerns with the cloud. Apple silicone is primed for local AI models with its GPU, Neural Cores and the unified memory architecture. I suspect that Apple is about to surprise everyone with what they do next. I'm very excited to see where they go with the M3, and what they release for both users and developers looking to harness the progress made in AI but locally.
- detourdog 4y agoJust yesterday I started using a new maxed out Mac mini and everything about it is snappy. I have no doubt that it is ready for enormous amount of background processing. Heavy background work is the only way to use the processing power in that little computer.
- samwillis 4y agoThink Siri+ChatGPT trained on all your email, documents, browser history, messages, movements, everything. All local, no cloud, complete privacy. "Hey Siri, I had a meeting last summer in New York about project X, could you bring up all relevant documents and give me a brief summary of what we discussed and decisions we made. Oh and while you're at it, we ate at an awesome restaurant that evening, can you book a table for me for our meeting next week."
- oidar 4y agoApple's assistive and accessibility features (on mobile) has always been way ahead of Android's - but this taking it to the next level. Talk about a moat.
- lern_too_spel 4y agoAndroid has on-device speech to text for what is happening around you and what is going on in phone calls built-in, which iOS still cannot do, and allows third party accessibility services. Apple remains far, far behind. For example, iOS's newly announced Detection Mode features have been available since Android 6. https://support.google.com/accessibility/android/answer/9031274?hl=en https://support.google.com/accessibility/android/answer/9031... iOS still doesn't have anything like Direct My Call, which is so useful that I use it as an unimpaired person. https://guidebooks.google.com/pixel/optimize-your-life/use-direct-my-call https://guidebooks.google.com/pixel/optimize-your-life/use-d... In general, just like with applications that aren't for accessibility, it is better to use a platform that lets you customize the system to fit your specific needs. We, as technologists, should understand this better than most. iOS simply fails here.
- nerdjon 4y agoI understand where you are going with this. But "We, as technologists" need to understand that that customization is a hard thing for many people. Most people, especially the people that part of what is announced today is targeted at, need something that is baked into the operating system and easier to manage. If an accessibility feature requires someone to get the help of someone else to setup it is already a failure right out the gate. They are still reliant on someone else to help manage their phone. Now yes there are situations where this is impossible to avoid, particularly for vision impaired people since you need to first set that up (but even that there are attempts to address this by the phone setup having those systems turned on by default). But those are the exceptions and should not be the rule for accessibility features. Edit: Just to be clear there is obviously a market for highly customizable accessibility tools similar to the Xbox Adaptive Controller which would need someone else's assistance with. But not everyone needs this level of support and where possible we should be making tools that allow someone to be fully self reliant and not rely on someone else for setup.
- ChildOfChaos 4y agoHonestly without needing to personally use the accessibility features, I think I might be taking a look at the new layouts, because I really yearn to make my device more minimalistic, there is just to much going on in modern devices. But Bravo to Apple once again for doing excellent accessibility features and continuing to improve them.
- efields 4y agoAccessibility makes life better for everybody. A lot of accessibility boils down to rethinking the obvious to enable _more_ use cases. "Things that might make your life better." Dig around in those settings and you might find your phone can do things you never thought of.
- kayodelycaon 4y agoThere are so many. One feature most people don't know about is macOS can speak the current time every 60, 30, or 15 minutes. (Settings > Control Center > Clock) It's a very old feature. Most people can't understand why they would want a computer speaking the time, it would drive them nuts. I have ADHD and no sense of time passing. It helps me offload keeping track of time. (Which is otherwise continuously looking at a clock.) I also turn off every auto-playing feature in any app that supports it. Some types of motion can be highly distracting. That can trigger a panic attack if I'm constantly needing to redirect my focus away from it. (If this sounds strange, it causes me to feel trapped in a tiny closet. Anxiety is a bitch.) Google's latest video conferencing iteration lets people spam flying emoji. It's a "fun" feature that is absolute hell for me. Fortunately, there is a buried setting to remove it from my view.
- efields 4y agoI never thought about using that feature but I should for the same reasons. I have a LCD digital clock right under my monitor even tho the OS has a clock of course. But as soon as I'm "immersed" in something, or the menubar is obscured bc I do keep some apps fullscreen, time does not exist. It also has the temp and humidity and looks attractive and runs on usb: https://www.amazon.com/gp/product/B088LZRT94/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&th=1 https://www.amazon.com/gp/product/B088LZRT94/ref=ppx_yo_dt_b... Its a good clock.
- vrglvrglvrgl 4y ago[dead]
- tailspin2019 4y agoThis really is Apple at their best. In fact it’s technology at its best. Nice to have something to comment on that doesn’t elicit any cynicism!
- nerdjon 4y agoI find it interesting that they are not waiting to talk about this at WWDC since I assume these features are tied to iOS 17. I wonder if that means that the simplified apps won't be available to developers (I don't see an App Store so I guess that makes sense). All of these features do seem really awesome for those that need it. Particularly the voice synthesis. I honestly just want to play with that myself and see how good it is and I am curious if they would use that tech for other things as well. The whole new simple UI I can really see being a major point. Especially if it includes an Apple Watch component and can still be synced with one for the safety features a watch has. Particularly fall detection. Edit: Maybe I missed it but this brings up an interesting problem. Is the Voice Synthesis only stored on the device and never backed up or synced to a new device. Can you imagine your phone breaking or you needing to upgrade after you lost your voice (but you had previously set that up) and you can no longer use it?!? I fully understand the privacy concerns of something like this being lost. But this isn't like FaceID that could just be easily re-created in some situations. So I really hope they thought about that.
- samwillis 4y agoIf they didn't save Personal Voice for WWDC, just think what they may have ready to announce there. On its own Personal Voice would have been a headline grabbing announcement, but they dropped it now. That suggests to me exciting things.
- nerdjon 4y agoI have been starting to wonder if this really is going to be a very packed WWDC. Between this announcement and the Final Cut Pro (and the other tool I don't remember now) announcement.
- simonbarker87 4y agoThis is a pattern they have gotten into in the last few years. Announce accessibility features a few weeks before WWDC. I think it’s so they don’t have to spend time on important features for the target demographic knowing that they will get swamped out by all the major OS features in the news cycle.
- nixpulvis 4y agoI guess I'm happy about this... but I find it kinda sad too. Apple used to be the minimalist, clean, and champions of the "it just works". Now so many people are getting lost in the gestures, repaint/caching, warring apps and incompatible standards, that this pairing down is increasingly necessary. It strikes me as something of a halfway point to a phone version of CarPlay. A safety feature that needs immediate investment. Car focus is overly prescriptive, and focus in general doesn't make my phone really safe in the car. And DO NOT start with me about Siri. I could rant forever, so don't let that take away from the meat of this announcement.
- apozem 4y agoPersonal Voice is remarkable. Millions of people will be able to create a synthetic voice to help themselves communicate. We live in the sci-fi future we always dreamed of. Sure, it's a dystopian future, what technology.
- mynameisvlad 4y agoWhat, exactly, is dystopian about an on-device generated voice? This is about as non-dystopian of an implementation as you can get.
- efields 4y agoLove the timing of this. "AI is gonna destroy jobs" vs. "Secure on-device AI can improve your quality of life." Narratives matter.
- smoldesu 4y agoMarketing matters. Apple's "narrative" is breaking their "privacy is a human right" motto so they can kowtow to China and keep their manufacturing margins. That's not very reassuring to people who want truly private AI hardware, but Apple can fix that with marketing. If you trust them to provide a secure model, I'd wager you haven't fully explored the world of iCloud exploitation.
- efields 4y agoI trust them more than I should but less than I could. In theory researches and hackers can and do watch network traffic while training an on-device model. Apple doesn't want their position of "on device AI is better for the consumer" to be tarnished, so I trust them to not screw around with this.
- precompute 4y agoI, for one, don't want a voice cloner in every hand. These things are very, very destructive. Obviously, this is a post about a new apple feature (even though great voice cloning has existed for months) so all the fanboys are unable to control their enthusiasm.
- rgovostes 4y ago“ Users can create a Personal Voice by reading along with a randomized set of text prompts to record 15 minutes of audio on iPhone or iPad.” The screenshot seems to show that you need to speak 150 sentences.
- MagicMoonlight 4y agoThe printing press is destructive if you rely on pieces of paper proving the king gave you powers… You just need better authentication that doesn’t rely purely on voice.
- kasperset 4y agoAlways nice to see accessibility features. I would love to see a way to share settings. There are so many hidden features and iOS settings is getting crowded and is very difficult to use. A "simplified" mode where only few selected apps are available like they have shown in the press release would be nice even for not so challenged people.
- elicash 4y agoI'm not the target audience for these features, and don't want to speculate on behalf of others, so I'll just focus on my own needs... Live Speech: I actually answer unknown phone numbers (usually) and would like text-to-speech on my calls because I've started to get concerned about what can be done, fraud-wise, with even small samples of my voice. So in this case, using another's voice is fine, even preferred. (Edit: I suppose I'd actually prefer a voice-changer here, which is less related to this accessibility feature. But I think Apple is unlikely to do that.) Personal Voice: When my girlfriend texts me when I'm out with my AirPods, I think we'd both like me to hear her message in her actual voice rather than Siri's. This feature doesn't allow for that yet, but the pieces are all there. Finally, Apple needs to detect and tell me when I'm listening to a synthetic voice, including when it's not being generated by Apple. There's fraud potential here. I'm clearly excited about this tech, but I want to know more on this front.
- kwertyoowiyop 4y agoI was thinking it would be fun just to have Siri use a Personal Voice, but your idea is better! And it could just offer to make your Personal Voice data available along with your Contact picture.
- bnj 4y agoWhile that sounds like it would unlock some very cool experiences it also scares me to think about the potential abuses of making personalized voice models fairly easily available. It seems like the sort of thing that would need to stay secure on your own device. It would be great to see some kind of middle ground where a text to speech mechanism would generate audio output and send that, rather than make the model itself available.
- deleted 4y ago[deleted]
- thiht 4y ago> Personal Voice: When my girlfriend texts me when I'm out with my AirPods, I think we'd both like me to hear her message in her actual voice rather than Siri's. That's genius!
- marban 4y agoSPJ would be proud.
- ciabattabread 4y ago> Assistive Access includes a customized experience for Phone and FaceTime, which have been combined into a single Calls app Hmm… telegraphing a future change?
- tikkun 4y agoI wonder if the “make the buttons larger” features will also help apps prepare for when we are using them on virtual reality and augmented reality, where they need to be bigger and with fewer options.
- devinprater 4y agoI wish they'd have a year of fixing accessibility bugs instead of making feature after feature. Like they had one release of 16 where if you opened the notification center with a Braille display connected, which is crucial for Deaf-Blind people, the display would disconnect. This was brought up during betas, but it still made it into production. Now there's this bug where if you're reading a book with your Braille display, after a page or two you can't scroll down a line to continue reading. Also they've been working on a new speech platform, and it's pretty buggy. I'm not saying Android is any better. We get a new Braille HID standard, in 2018, and the Android OS doesn't support it yet. So what does the TalkBack team have to do? Graft drivers for each Braille HID display into TalkBack, Android's screen reader like VoiceOver, with another driver coming in TalkBack 14 cause of course they can't update Android Accessibility suite like they do Google Maps, Google Drive, Google Opinion Rewards, and even Google Voice gets an update every few weeks. I mean, the accessibility suite is not a system app. If it were, it could just grab Bluetooth access and do whatever. But it's not, so it should be able to be updated far more frequently than it is. It's sad that Microsoft out of all these big companies that'll talk and talk and talk, which doesn't always include Apple, that has HID Braille support in the OS. Apple has HID Braille support too. Google doesn't, though, neither in Android or ChromeOS. They just piggy-back off of BRLTTY for all their stuff.
- specialist 4y agoOrganizationally, I'd love a separate "cleaning crew", whose primary job is chewing thru the back log. Outside of the release cycle. There's dozens of us who revel in polish, fit, and finish.
- latexr 4y agoIt’s not just accessibility, everything about their operating systems is crawling with bugs piling up on each other. They have bugs in Passwords, bugs in Shortcuts, bugs in permissions, bugs in Clock… I can no longer even trust that setting an alarm will be done for the correct time.
- Spivak 4y agoI'm guessing this is the "I wants alarms to be pinned to a specific moment in time and not the time the alarm is set to in the current timezone" thing. It would be nice if this was an option but I can't really fault them for not including it since it's kinda niche.
- frankus 4y agoI’ve been digging into Apple’s (existing) accessibility features last week and it made me think about what (for lack of a better term) an “accessibility first” app architecture might look like. Current app UIs are all about how to visually represent the objects you can interact with and the actions you can take on them, and then accessibility features are layered on top. (Warning: half-baked idea that’s probably been tried countless times) what if you started with semantic information about the objects and the actions you can take on them and then the GUI is just one of several interaction modes (along with voice, keyboard, CLI, etc)?
- jdlshore 4y agoThis was the original premise of the Smalltalk Model-View-Controller architecture. (Not to be confused with web MVC, which reused the name for something else.) The “Controller” in Model-View-Controller refers to the input device, and a given Model can have multiple independent Views and Controllers. The “Model” is supposed to an object that’s a semantic representation of the underlying thing being manipulated. One of the visible impacts of MVC is that changes occur in real-time: you modify a value in a dialog, and everything affected by that value instantly updates. This is already common in Mac apps (in contrast to Windows apps, which typically want you to press “ok” or “apply”), so it wouldn’t surprise me if Apple was already using a modern MVC variant. It’s a well-known pattern.
- alexjm 4y agoIn the Apple documentation for MVC, "controller" refers to a class that sits between the model and view. When data changes in the model, it updates the view; and when the user interacts with the view, it passes events to the model. https://developer.apple.com/library/archive/documentation/General/Conceptual/DevPedia-CocoaCore/MVC.html#//apple_ref/doc/uid/TP40008195-CH32-SW1 https://developer.apple.com/library/archive/documentation/Ge... Elsewhere, the documentation contrasts the Cocoa and Smalltalk versions of MVC where all three pieces communicate directly: https://developer.apple.com/library/archive/documentation/Cocoa/Conceptual/CocoaFundamentals/CocoaDesignPatterns/CocoaDesignPatterns.html#//apple_ref/doc/uid/TP40002974-CH6-SW22 https://developer.apple.com/library/archive/documentation/Co... Like you said, this separation means you can "drive" the same model through different UIs. That's one of the things I always thought was cool about AppleScript support -- the app exposes a different interface to the same model.
- victor106 4y agoApple gets lot of flak here in HN. But these features are really commendable. The personal voice feature is one of the best uses of AI I have read about in recent times. Kudos to Apple!!!
- KyeRussell 4y agoI 100% believe that Apple is putting real effort into co-design of these features in a way that other similarly positioned companies do not. As someone with a disability, these features—even those do not cater to my disability—speak to me in a much more direct way than the typical “let’s guess what the disabled people want” bucket of accessibility features.
- DrScientist 4y agoComputers being able to impersonate your voice is clearly an area that is a danger in AI. The tech has been around a while, but is getting better and better. If I had a job as a voice-over artist, I'd be worried.
- abledon 4y agoFinally! Such a simple idea thats taken so long. My parents & grandparents are going to LOVE this. Only thing they need now is a simplified user interface for Apple Podcasts, 1 click button to listen to the latest episode of a certain podcast on there
- santiagobasulto 4y agoOff-topic: when you work with multiple monitors, wouldn't you like some sort of eye-tracking mechanism that could identify what window you're looking at, and immediately shift the focus to that? I have several consoles open in different monitors and sometimes I accidentally run commands in some because the focus is in some other one :/
- crims0n 4y agoHow would that work when you just want to glance at another window but not bring it into focus?
- sergiomattei 4y agoAssistive Access looks great! This is perfect for my grandfather with Parkinson's, who often struggles with his phone due to the deterioration of his motor skills.
- alden5 4y agoSame thought here! it really sucks that 3g networks shut down making most flip phones functionality useless. there really aren't any modern smart phones designed for people who want something easy to use which makes this announcement so exciting
- jalada 4y agoI know there's a lot of concerns about generative voices, but it's a shame the only solution is 'insist on a live recording of random phrases'. For those whose voices have already degenerated, but who have hours of recordings available from historical sources (e.g. speech therapy sessions), it's too late to ask them to record something fresh. Don't get me wrong, it's fantastic to see the tech being used this way. My Dad has lost most of his speech due to some kind of aphasia-causing condition and if this had been available just a year or two ago it could've been a big help for him; it's reassuring that others earlier in the journey will benefit from this.
- elicash 4y agoIt's not necessarily the only solution, just the one Apple has started with. My guess is that at least in part there are technical reasons, since even this structured approach will require overnight processing (source: WaPo) by Apple. I do think additionally, in the case for a situation like with your dad, Apple would need to verify that he is the same person that there's hours of audio of. That strikes me as a difficult at Apple's scale.
- desro 4y agoYou may want to check out Rhasspy/Piper [0,1]. The Piper page includes training instructions. [0] https://github.com/rhasspy https://github.com/rhasspy [1] https://github.com/rhasspy/piper https://github.com/rhasspy/piper
- johnwayne666 4y ago> Users who are sensitive to rapid animations can automatically pause images with moving elements, such as GIFs, in Messages and Safari. That’s so nice. I hate when stuff moves in my vision when I’m trying to read something.
- JustSomeNobody 4y agoIs it digitally watermarked so that I know I'm listening to an AI version of someone's voice? If not, why did Apple think I would not want to know that bit of information.
- qgin 4y agoThese features that will be built into the operating system are things that otherwise would have cost someone hundreds to thousands of dollars before... if they even existed at all. I love that Apple chooses to invest in these areas of accessibility that are extremely difficult to make sustainable businesses out of without charging users exorbitant sums.
- pcurve 4y agoI'm in my mid 40s, and I can see myself using these because I can no longer read things clearly without reading glasses, including restaurant menus. And yay to the super tacky looking deep drop shadows and rounded corners. Hate them all you want, but they're good for affordance.
- bkandel 4y agoAnother underserved group of users is people with ADHD. I think a "minimize distractions" mode at the OS level would be very welcome by a lot of people.
- dagmx 4y agoThe OS does have focus modes as of a year or two ago. You can set it up to only allow the apps and notifications you want. Plus you can have multiple to suit the context you’re in
- oliyoung 4y agoAs @dagmx said above, we've already had a great bunch of features added in the last 18 months, time and geo sensitive focus modes that can lock a device to only certain apps and/or certain features, notification center batches notifications up instead of them being drip fed
- andy_xor_andrew 4y agoApple really is the sleeping giant on AI. It would be totally within their MO to suddenly wake up, and turn this cutting edge AI stuff, which no one is quite sure what to do with, into a killer app with super high quality. Fingers crossed.
- specialist 4y agoThis announcement links to demo reels of actual users. More of this, please. I wish Apple would produce Starfire style demos showing off their products. In context narratives showing how real people use stuff. Covering features old and new. https://en.m.wikipedia.org/wiki/Starfire_video_prototype https://en.m.wikipedia.org/wiki/Starfire_video_prototype I so want the voice interface future. I became addicted to audiobooks and podcasts during the apocalypse. Hours and days outside, walking the dogs, hiking, gardening. I made multiple attempts to adapt to Siri and Voice Activated input. Hot damn, that stuff pissed me off. Repeatedly. So I'd have to stop, take off gloves, fish out the phone, unfsck myself, reassemble, then resume my task. Again and again. How very modal. This mobile wearable stuff is supposed to be seamless, effortless. Not demand my full attention with every little hiccup. So I just gave up. Now I suffer with the touch UI. And aggrevations like recording a long video of my pocket lint and invoking emergency services. Maybe I should just get a Walkman. Transfer content to cassette tapes.
- jmbwell 4y agoAside: "Apple Newsroom needs your permission to enable desktop notifications." Boo. Boo this page. It only needs that permission if I want to enable that. C'mon, Apple. You know better than this.
- nitins_jakta 4y agoGreat stuff. Next, would love to see Apple give an option for people sensitive to temporal dithering or PWM. It triggers migraines (or vestibular migraines), tension headaches and dizziness in a minority. See https://www.change.org/p/apple-add-accessibility-options-to-reduce-eye-strain-and-support-vision-disability-sufferers https://www.change.org/p/apple-add-accessibility-options-to-..., or FlickerSense.org, or LEDStrain.org forum.
- achalkley 4y agoGreat preparation for Reality Pro
- billiam 4y agoNot sure why everyone thinks local language processing, generation and voice synthesis has anything to do with privacy. Apple's business model has supported their relatively pro-privacy approach (along with how bad they are at a lot of cloud services) but doing anything useful with a 30B token LLM stored on your machine is still going to require the Internet, and your AI Personal Assistant will be just as tracked and cracked as you are today.
- Legtar 4y agoThis is completely incomprehensible to me. Okay, Russia's image is far from being the best now, and it's hard for many to even stand next to it. But Apple does not go away and continues to collect money. Yes, and they speak Russian not only in the Russian Federation. Almost the entire former CIS could use it, but here they cut it down to only Ukrainians. Disabled people from Kazakhstan, Belarus and other countries somehow guilty?
- SoftTalker 4y agoSeveral comments expressing delight at the personal voice thing, I think it sounds completely creepy.
- cglong 4y agoOff-topic, but I'm getting tired of Apple creating a Proper Noun for every new feature they want to include in marketing. They're always so vague and/or obtuse that I keep forgetting them and what they mean. As an example, I thought I knew what ProMotion was but am realizing now that I was confusing it with True Tone.
- heywhatupboys 4y agopoint of Apple products is that users don't have to care
- at-fates-hands 4y agoI had two relatives die from ALS. When my grandfather lost his ability to speak, it was frustrating for him because he was such an intelligent, articulate person. Having a disease that renders your voice useless and then having to communicate via a small whiteboard for him was not fun. He couldn't write fast enough and often times felt like a burden because we would all be waiting to see what he wanted to say. the Live Speech features for people with ALS will be a game changer. It saddens me this wasn't around when my grandfather passed, but am optimistic others who have this horrendous disease can utilize it to continue to communicate with their families even when ALS has taken their voice.
- russellbeattie 4y agoIf you haven't looked at the accessibility features on your iPhone, you should check them out. There's some interesting stuff there already. Though it's a little awkward to use, the facial gesture functionality is really interesting. I feel that many features currently focused on accessibility will soon be integrated into the main user interface as AI becomes a more important part of our computing experience. Talking to your phone without a wake word, hand gestures, object recognition/detection, face and head movements, etc. are all part of the future HCI. Live multimodal input will be the norm within the decade. It's taken a while for people to get used to having a live mic waiting for wakewords, and it'll take them a while to get used to a live camera (though this is already happening with Face ID), but sooner than later, having a HAL 9000 style camera in our lives will be the norm.
- nntwozz 4y agoApple accessibility features are second to none. They have been leading the charge ever since Mac OS X 10.0 Cheetah 22 years ago.
- hassancf 4y agoSummary: “Apple has announced new accessibility features for its devices, including Live Speech, Personal Voice, and Point and Speak in Magnifier. These updates will be available later this year and will help people with cognitive, vision, hearing, and mobility disabilities. Live Speech will read aloud text on the screen, while Personal Voice will allow users to create a custom voice for their device. Point and Speak in Magnifier will provide a spoken description of what is being pointed at. These new features are part of Apple's ongoing commitment to making its products accessible to everyone.” By Bard in 100 words
- zakki 4y agoI’m exited to try Personal Voice feature. If it happened years ago I could create the voice of my parents, grand parents and other close people to me. It will be wonderful to hear their voice again. Hmm I wonder if we can extract a voice from a video and feed it to Personal Voice.
- sergiomattei 4y agoOmg! I must do this now with my grandma
- scosman 4y agoThe is is amazing. I have a non speaking person in my life and the idea of them being able to create their own unique voice is so powerful. Stephen Hawkins kept his voice synth years after better tech was available because he wanted to keep his voice. If anyone here is interested-in or working-on open-source tech for the non speaking please reach out. I’m building tech that uses LLMs and Whisper.cpp to greatly reduce the amount of typing needed. What apple has here is great, it still requires typing in real-time to communicate. Many of the diseases that take your voice also impact fine motor control, so tools to be expressive with minimal typing are super important. Details (and link to GitHub projects) here: https://scosman.net/blog/introducing_voicebox https://scosman.net/blog/introducing_voicebox
- dzhiurgis 4y agoThey would enable 10x more people if they allowed to use their assistant with 3rd party language recognition service that supports languages remaining 60% of worlds population...
- knaik94 4y agoOne of the most useful accessibility features, as someone who doesn't require any, has been the live caption feature. I have no hearing or vision impairments, but I do struggle with ADHD. It was launched a while ago, along with audio detection for things like doorbells or alarms. I was hoping multi-language translations to be announced along with this. Currently things are still limited to English (U.S.) or (Canada) audio and text. It's been so helpful to be able to read a short transcript of what was just said. The live caption feature works on video calls, and while multi-speaker captioning isn't perfect, it mostly works. I also really like how Android, iOS, and Windows all seem to keep feature parity among the operating systems. I wonder how Google and Microsoft will respond to this and I wonder how Personal Voice will work for communication outside of the Apple ecosystem.
- prepend 4y agoCan I read an ebook to myself using personal voice? That’s what I really want. Or have my dad train his voice and listen to him read me books whenever I like?
- oliyoung 4y ago"Burying" Personal Voice halfway down a press release, in the second item, is so typically Apple. > Users can create a Personal Voice by reading along with a randomized set of text prompts to record 15 minutes of audio on iPhone or iPad. That's a monumental software feature to deliver on a consumer device, with massive potential, but there it is, as just another dot point
- tonymet 4y agoI’d love to learn about Apple’s Accessibility design process, as their features are much more advanced than other platforms. As in what sort of user research, audience research is done; how they decide on which communities to support, and which features to build.
- valianteffort 4y agoThat assistive access home screen is essentially what I had whittled my parents phones down to. But they would inadvertently swipe in some direction and get stuck somewhere and become confused. Big thanks to Apple for this.
- totetsu 4y agoDoes "any switch" in switch control include an Nintendo Switch?
- MagicMoonlight 4y agoPersonal Voice sounds cool, I’m going to try it out even though I don’t need it. Would be interesting to be able to get my phone to talk for me.
- Legtar 4y agoThis is completely incomprehensible to me. Okay, Russia's image is far from being the best now, and it's hard for many to even stand next to it. But Apple does not go away and continues to collect money. Yes, and they speak Russian not only in the Russian Federation. Almost the entire former CIS could use it, but here they cut it down to only Ukrainians . Disabled people from Kazakhstan, Belarus and other countries somehow guilty?