Gaussian splatting enables real-time streaming of volumetric video in UE5

The research team at Temporal Games has developed a plugin for real-time streaming of volumetric video using Gaussian splatting in Unreal Engine 5. Animated Gaussian splatting makes it possible to represent real events or performances as three-dimensional projections of reality. The challenge lies in the large amount of data required to render the animation. The team was able to reduce the data size by a factor of 15. In a recently published video, the researchers also show how the integrated image can be dynamically lit in real time. The team plans to develop a client-server solution for 4DGS streaming and to make the technology available for games and web platforms.