Content
summary Summary

Video game voice actress Amelia Tyler says a clone of her voice was used to read out rape pornography, according to a report from Eurogamer.

Ad

Tyler, who received a BAFTA nomination for her role as the narrator in the video game "Baldur's Gate 3", describes a very negative experience with AI-generated speech. She says her voice and those of other actors in the game were cloned by AI without their consent.

During a livestream, Tyler heard her cloned voice read rape pornography after viewers typed the text into a text-to-speech generator. She explained that she and several other actors have experienced such incidents since the game's release.

While she welcomes players to record their own voiceover versions because she enjoys game modifications, Tyler believes it should be illegal to use her voice for mods without her permission.

Ad
Ad

She argues that using actors' voices for AI without their consent is not only stealing their work, but also their identity. Tyler calls for a ban on this practice if those involved did not consent.

We have plenty of evidence that voice clones are more dangerous than useful

OpenAI recently announced it would not release its voice clone generator "Voice Engine" for now due to misuse risks. But that matters little because there is open-source software and numerous commercial products on the market that can generate convincing voice clones from just a few seconds of source audio. There's no regulation for this software.

Cybersecurity researchers recently demonstrated that fraudsters can splice voice clones into phone calls to enable financial scams. This is one of the reasons OpenAI urged financial institutions to rethink voice verification when it unveiled its voice clone model. Voice clones also run the risk of enabling voter fraud.

There are some positive uses for voice cloning, such as preserving the original voices of people with vocal disorders, like actor Val Kilmer. However, from an overall societal perspective, the risks and potential harms of AI voice cloning technology seem to outweigh the benefits.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Video game voice actress Amelia Tyler says that her voice and those of other actors in "Baldur's Gate 3" were cloned by an AI without her consent and used in rape porn.
  • Tyler calls for a ban on the use of voices for AI without the consent of those involved, as it is a theft of their work and identity.
  • Despite positive applications for voice cloning, such as for voice disorders, the risks of financial fraud and voter manipulation currently seem to outweigh the benefits to society as a whole.
Sources
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.