Content
summary Summary

World Labs has developed an AI system that turns individual photos into three-dimensional environments you can explore in a web browser. While innovative, the technology faces significant technical constraints in its current form.

Ad

The company says its system stands apart from other AI models in the field because it generates consistent 3D environments rather than just pixels. These virtual spaces maintain stability and follow basic physics rules.

Opulentes Palastinterieur mit Bedienoberfläche: WASD-Tasten zur Navigation, Maussteuerung für Umsicht, goldene Kronleuchter und Barockgemälde.
Various demo worlds are available on the World Labs website, which users can navigate through using a mouse and keyboard. | Image: World Labs

Limited movement, visible glitches

The technology's current limitations are substantial. Users can only move a few virtual meters before hitting invisible barriers. The system also shows regular rendering problems, with objects sometimes merging incorrectly.

Video: Eric Solorio/World Labs

Ad
Ad

The platform includes various camera features like adjustable depth of field and dynamic lighting. World Labs describes this release as an "early preview." The company generated the initial 2D images using several AI tools: Flux 1.1 Pro, Ideogram, Midjourney, and DALL-E.

So far, World Labs has only shown demo environments. The company hasn't released preview software or published technical documentation with benchmarks.

Video: Brittani Natali/World Labs

High investment despite early stage

Despite being in early development, World Labs has secured $230 million in venture funding. Reuters reports that investors include venture firms Andreessen Horowitz and New Enterprise Associates, along with tech companies AMD, Intel, and Nvidia.

The 20-person company was founded by AI researcher Fei-Fei Li, who created the ImageNet project and previously led Google Cloud's AI division. Through World Labs, Li aims to develop "large world models" capable of understanding three-dimensional physical spaces.

Recommendation

While World Labs plans to launch its first commercial product in 2025, it remains unclear whether the company can overcome its technical challenges by then.

Major advances in world models

AI-powered 3D generation has seen major progress lately. WonderWorld, introduced last fall, cut generation time for new 3D scenes from hours to just ten seconds.

Another development came from startups Etched and Decart with their "Oasis" project. This system creates playable 3D worlds in real time at 20 frames per second.

While the Minecraft-style game world allows basic interactions like moving, jumping, and picking up objects, it shows consistency issues. Players turning around might find themselves in an entirely different environment than before.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • AI startup World Labs has developed a system that uses individual photographs to generate three-dimensional environments that can be walked through in a browser. According to World Labs, the technology enables consistent 3D worlds that follow the laws of physics, but still has significant limitations in terms of freedom of movement and rendering.
  • Despite its early stage of development, World Labs has already raised $230 million in venture capital from investors including Andreessen Horowitz, New Enterprise Associates, AMD, Intel, and Nvidia. Founder Fei-Fei Li plans to develop "large world models" that can understand the three-dimensional physical world.
  • The development of AI-assisted 3D generation has made significant progress in recent years, as demonstrated by Etched and Decart's WonderWorld projects and "Oasis", which can drastically reduce the time needed to generate new 3D scenes and generate playable worlds in real time.
Jonathan works as a freelance tech journalist for THE DECODER, focusing on AI tools and how GenAI can be used in everyday work.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.