Content
summary Summary

With DLSS 3, Nvidia promises a performance leap by a factor of four. A new technique that predicts entire frames is supposed to take AI-based rendering to the next level.

With AI-powered rendering like Nvidia’s DLSS, development studios can render more visual detail or higher frame rates with the same processing power. The performance gains from this software optimization can be greater than hardware upgrades.

DLSS 1 and 2 are upscaling-optimized neural networks that can add matching pixels to a scene, upscaling the image without additional computational effort. The networks were trained with low and extremely high resolution (16K) screenshots to learn the difference between resolutions. DLSS 2 is compatible with more games than DLSS 1 thanks to a new training approach.

DLSS 3: Nvidia lets AI predict entire frames

With DLSS 3, Nvidia says it is introducing a new generation of AI rendering: DLSS 3 calculates entire frames without putting any load on the actual graphics pipeline. DLSS 3 takes the speed and direction of movement of individual pixels into account for an AI-supported interframe calculation.

Ad
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer

According to Nvidia, this new neural rendering function (“Optical Multi Frame Generation”) can reconstruct up to seven-eighths of the displayed pixels with AI, which can increase the frame rate by four times compared to an image without DLSS.

Three-quarters of the first frame is rendered with DLSS Super Resolution and the entire second frame is rendered with DLSS Frame Generation. “Some pixels are calculated, most are predicted,” says Nvidia CEO Jensen Huang.

DLSS 2 AI upscaling | Image: Nvidia
DLSS 3 also takes motion data into account, predicting entire frames instead of just individual pixels. | Image: Nvidia

With DLSS 3, even typically CPU-limited games in large worlds or with complex physics are supposed to run on an Ada GPU with a higher frame rate than the CPU could normally calculate.

35 games at launch – starting in October

Graphically particularly demanding games, especially due to the complex ray tracing light calculation, are supposed to benefit especially from DLSS 3. Nvidia promises more than a doubling of the frame rate in Microsoft Flight Simulator with activated ray tracing, for example.

DLSS 3 benchmark | Image: Nvidia

DLSS 3 is supported by more than 35 games (see below) including ray tracing at launch, among them graphically complex titles like Cyberpunk 2077 or the previously mentioned Flight Simulator.

Recommendation

DLSS 3 and compatible games are scheduled to hit the market in October. The new neural rendering feature has only been announced for the new GeForce RTX-40 cards so far.

  • A Plague Tale: Requiem
  • Atomic Heart
  • Black Myth: Wukong
  • Bright Memory: Infinite
  • Chernobylite
  • Conqueror’s Blade
  • Cyberpunk 2077
  • Dakar Rally
  • Deliver Us Mars
  • Destroy All Humans! 2 – Reprobed
  • Dying Light 2 Stay Human
  • F1Ⓡ 22
  • F.I.S.T.: Forged In Shadow Torch
  • Frostbite Engine
  • HITMAN 3
  • Hogwarts Legacy
  • ICARUS
  • Jurassic World Evolution 2
  • Justice
  • Loopmancer
  • Marauders
  • Microsoft Flight Simulator
  • Midnight Ghost Hunt
  • Mount & Blade II: Bannerlord
  • Naraka: Bladepoint
  • NVIDIA Omniverse
  • NVIDIA Racer RTX
  • PERISH
  • Portal with RTX
  • Ripout
  • S.T.A.L.K.E.R. 2: Heart of Chornobyl
  • Scathe
  • Sword and Fairy 7
  • SYNCED
  • The Lord of the Rings: Gollum
  • The Witcher 3: Wild Hunt
  • THRONE AND LIBERTY
  • Tower of Fantasy
  • Unity
  • Unreal Engine 4 & 5
  • Warhammer 40,000: Darktide
Ad
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Join our communit
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Nvidia integrates artificial intelligence even deeper into graphics rendering.
  • DLSS 3 takes pixel movements into account and can predict entire frames.
  • This enables a performance increase by a factor of four - with the same computing power.
Online journalist Matthias is the co-founder and publisher of THE DECODER. He believes that artificial intelligence will fundamentally change the relationship between humans and computers.
Join our communit
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.