Ad
Skip to content

If you still trust online video, take a look at TANGO

Image description
Liu et al.

A new AI system called TANGO can generate realistic videos of people gesturing and moving to match any audio recording. This technology could make it even harder to spot fake videos online.

TANGO works in three main steps. First, it analyzes reference videos to create a "motion graph" of possible body positions. The motion graph represents possible transitions between different postures or body positions. It's created by analyzing reference videos of a person moving.

Next, it selects appropriate movement sequences to match a target audio clip. Finally, an AI model generates transitional frames to create smooth motion.

The researchers say TANGO's key innovation is using "hierarchical audio motion embedding." This allows it to capture both short-term and long-term connections between speech and gestures, resulting in more natural-looking movements.

Ad
DEC_D_Incontent-1

Collage: Various people gesticulate in front of colorful backgrounds, TANGO logo placed in the middle.
TANGO generates gesture video in three steps: creation of a motion graph, audio-based path selection and interpolation of discontinuous transitions. This method enables the synthesis of realistic gesture video segments to match audio input. | Image: Liu et al.

In tests, TANGO outperformed existing methods on both objective metrics and in user studies. The system could potentially be used in film production or for virtual avatars but, of course, also for easier and more convincing deepfakes.

Fake video seems unstoppable these days

As AI-generated videos become increasingly realistic, it's getting harder for people to verify what's real online. Trusting reputable sources may become more important than trying to authenticate every video. The sheer volume of potential fakes makes catching them all nearly impossible.

TANGO shows how advanced synthetic media creation has become. Users should be very skeptical of supposedly authentic videos from unverified sources.

AI News Without the Hype – Curated by Humans

As a THE DECODER subscriber, you get ad-free reading, our weekly AI newsletter, the exclusive "AI Radar" Frontier Report 6× per year, access to comments, and our complete archive.

AI news without the hype
Curated by humans.

  • Over 20 percent launch discount.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder