3 ms·

I am not sure why this is being developed. The potential for misuse is so much greater than any possible beneficial use cases I can imagine. Text to speech is c

I am not sure why this is being developed. The potential for misuse is so much greater than any possible beneficial use cases I can imagine. Text to speech is cool, why do you have to introduce technologies that allow for voice cloning, which will inevitably be used (more than it already is) to commit fraud and hurt people? Society is not ready for all of these "intelligences", heck, we can't even figure out what to do about all the drawbacks of social media and we've had it for decades.

vouaobrasil 3y ago
> I am not sure why this is being developed. The potential for misuse is so much greater than any possible beneficial use cases I can imagine. It's being developed because for decades, tech companies have touted the supposed benefits of new technology and hidden the costs. It's been an avalanche effect of greater and greater technology for greater and greater costs. Only now, the costs are so great that people are starting to wake up. When we look back in time to see the devastation wrough by technology, we won't look at AI as the starting point. It will be the smartphones, the 4G internet, and the 8K video that we so blindly accepted without ever considering the immense changes to society that they implied. AI may be the start of the end of reasonable society, but it is only the APEX of a phenomenon that has been happening ever since we accepted fossil fuel use without considering the implicates of climate change. It's an entire societal attitude.
MyFedora 3y ago
I feel like I'm missing smth here? Voice cloning has a good benefit to drawback ratio compared to many technologies. Threat actors with enough resources could always clone your voice. Everyone can hire voice actors. Costs more time and money sure, but it was always possible. Beneficial use cases: * Accessibility: Give people that lost their voice their voice back. * Personalized Digital Assistants: More humane voice. * Voiceovers: Sick content creator can let the AI do the voice, filmmakers can fix mistakes in post and so on and so forth. * Language Learning: Learn an accent by mimicking how the AI voices yourself in the target accent. * Audiobook Narration: Make a good audiobook out of a textbook. * Preservation of Cultural Heritage: Preserve an accent that's about to die out. * Corporate Training: Believe it or not, a robotic voice sucks to listen to after a while. * Interactive Gaming: Entire virtual DND campaign based on a prompt with AI generated world, story, and characters drawn and voiced by AI with quality control by AI. Now compare that to guns, tanks, flamethrowers, chemical weapons, atomic bombs, hydrogen bombs, killer drones and bombers. Yeah uh... death. Made to kill people.
- notRobot 3y ago
  You are indeed missing something: you don't need machine powered instant voice "cloning" tech to have good artificial voices, which would do basically everything you're talking about. Voice cloning has always been technically possible and so has fake videos but lowering the barrier of entry to voice cloning and deepfakes has very real implications for society that we're not remotely equipped to deal with. Nothing is believable anymore. Stuff like this will only become more commonplace: https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-hong-kong-intl-hnk/index.html https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-ho... https://news.cgtn.com/news/2024-03-03/AI-deepfake-scams-tricked-Australians-out-of-5-2-million-in-2023-1rFbYCqOKis/p.html https://news.cgtn.com/news/2024-03-03/AI-deepfake-scams-tric... https://www.trendmicro.com/vinfo/es/security/news/cybercrime-and-digital-threats/how-cybercriminals-can-perform-virtual-kidnapping-scams-using-ai-voice-cloning-tools-and-chatgpt https://www.trendmicro.com/vinfo/es/security/news/cybercrime... https://www.newyorker.com/science/annals-of-artificial-intelligence/the-terrifying-ai-scam-that-uses-your-loved-ones-voice https://www.newyorker.com/science/annals-of-artificial-intel...

vouaobrasil 3y ago

> I am not sure why this is being developed. The potential for misuse is so much greater than any possible beneficial use cases I can imagine. It's being developed because for decades, tech companies have touted the supposed benefits of new technology and hidden the costs. It's been an avalanche effect of greater and greater technology for greater and greater costs. Only now, the costs are so great that people are starting to wake up. When we look back in time to see the devastation wrough by technology, we won't look at AI as the starting point. It will be the smartphones, the 4G internet, and the 8K video that we so blindly accepted without ever considering the immense changes to society that they implied. AI may be the start of the end of reasonable society, but it is only the APEX of a phenomenon that has been happening ever since we accepted fossil fuel use without considering the implicates of climate change. It's an entire societal attitude.

MyFedora 3y ago

I feel like I'm missing smth here? Voice cloning has a good benefit to drawback ratio compared to many technologies. Threat actors with enough resources could always clone your voice. Everyone can hire voice actors. Costs more time and money sure, but it was always possible. Beneficial use cases: * Accessibility: Give people that lost their voice their voice back. * Personalized Digital Assistants: More humane voice. * Voiceovers: Sick content creator can let the AI do the voice, filmmakers can fix mistakes in post and so on and so forth. * Language Learning: Learn an accent by mimicking how the AI voices yourself in the target accent. * Audiobook Narration: Make a good audiobook out of a textbook. * Preservation of Cultural Heritage: Preserve an accent that's about to die out. * Corporate Training: Believe it or not, a robotic voice sucks to listen to after a while. * Interactive Gaming: Entire virtual DND campaign based on a prompt with AI generated world, story, and characters drawn and voiced by AI with quality control by AI. Now compare that to guns, tanks, flamethrowers, chemical weapons, atomic bombs, hydrogen bombs, killer drones and bombers. Yeah uh... death. Made to kill people.

notRobot 3y ago
You are indeed missing something: you don't need machine powered instant voice "cloning" tech to have good artificial voices, which would do basically everything you're talking about. Voice cloning has always been technically possible and so has fake videos but lowering the barrier of entry to voice cloning and deepfakes has very real implications for society that we're not remotely equipped to deal with. Nothing is believable anymore. Stuff like this will only become more commonplace: https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-hong-kong-intl-hnk/index.html https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-ho... https://news.cgtn.com/news/2024-03-03/AI-deepfake-scams-tricked-Australians-out-of-5-2-million-in-2023-1rFbYCqOKis/p.html https://news.cgtn.com/news/2024-03-03/AI-deepfake-scams-tric... https://www.trendmicro.com/vinfo/es/security/news/cybercrime-and-digital-threats/how-cybercriminals-can-perform-virtual-kidnapping-scams-using-ai-voice-cloning-tools-and-chatgpt https://www.trendmicro.com/vinfo/es/security/news/cybercrime... https://www.newyorker.com/science/annals-of-artificial-intelligence/the-terrifying-ai-scam-that-uses-your-loved-ones-voice https://www.newyorker.com/science/annals-of-artificial-intel...