Content
summary Summary

Tencent has released version 2.0 of Hunyuan3D, an open-source generative AI system that creates textured 3D models from regular images.

Ad

The system splits the work between two specialized components: one that handles the basic 3D shapes, and another that adds realistic textures.

Video: Tencent

Under the hood, the system uses Hunyuan3D-DiT, a diffusion transformer model that figures out the core shapes of objects and represents them in compressed form. Once it understands the basic structure, it creates 3D shapes that closely match the input image.

Ad
Ad

The texturing happens through Hunyuan3D-Paint, which looks at details like surface angles and positions to create textures that look natural from any viewing angle. The system even removes lighting effects from the original image, ensuring the textures work well in any lighting condition.

Technical diagram: Hunyuan 3D 2.0 architecture with two main components for 3D mesh generation and texturing.
Hunyuan3D-DiT creates the basic framework from an input image, while Hunyuan3D-Paint generates textures based on geometric conditions such as normal and position maps. | Image: Tencent

The latest version offers several improvements over its predecessor. Shape recognition now captures fine details such as edges and corners more accurately, resulting in better reproduction of faces, surface patterns, and text. The researchers say the new models come out clean, without the holes and errors that often plague 3D generation.

Tests show that Hunyuan3D 2.0 outperforms similar tools across the board - in shape generation, texturing, and overall model quality. One striking example shows the system accurately reproducing readable text on a sign held by a penguin model.

Comparative study: three series of 3D models show penguins, penguin figures in motion and mountain landscapes in different rendering variants.
Compared to earlier systems, the new Hunyuan model shows significant improvements in surface detail, motion rendering, and complex structures with realistic textures. | Image: Tencent

Hunyuan3D-Studio: Bringing AI 3D creation to the web

To make the technology more accessible, Tencent launched Hunyuan3D-Studio, a web-based toolkit for 3D creation. Users can convert sketches to 3D models, simplify complex designs, and even animate characters - though access requires logging in through WeChat, QQ, or a Chinese phone number.

By releasing the system as open source, Tencent hopes to create a foundation for future 3D AI models and encourage further research. The move comes as other tech giants like Nvidia, Stability AI, and Meta push forward with their own advances in AI-powered 3D generation.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Recommendation
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • Tencent researchers have released Hunyuan3D 2.0, an open-source system that generates textured 3D models from images, consisting of Hunyuan3D-DiT for 3D shapes and Hunyuan3D-Paint for textures.
  • Hunyuan3D-DiT recognizes the essential shapes of a 3D object as a diffusion transformation model and generates 3D shapes that match the input image, while Hunyuan3D-Paint generates textures based on surface orientations and positions.
  • In tests, Hunyuan3D 2.0 outperformed comparative models in generating 3D shapes, textures, and finished 3D models in terms of quality and similarity to the input image, and the web-based Hunyuan3D Studio provides tools for 3D production.
Sources
Jonathan works as a freelance tech journalist for THE DECODER, focusing on AI tools and how GenAI can be used in everyday work.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.