Fei-Fei Li's World Labs unveils its world-generating AI model

"At the Marble Labs website, creators can now input text prompts, images, or videos of pieces of a real-world environment. Marble uses them to create full 3D environments, which can include interior spaces or expansive exterior ones. Marble can reconstruct, generate, and simulate 3D worlds-think of it as a type of "world model." In an interview with Fast Company, Li describes world models as a "significant" evolution of the generative AI era."

"This week, Li posted a sort of manifesto on Substack arguing that spatial intelligence is the next frontier in AI. For humans, she says, spatial intelligence of the physical world around us provides the scaffolding upon which we build our cognition. "Spatial intelligence will transform how we create and interact with real and virtual worlds-revolutionizing storytelling, creativity, robotics, scientific discovery, and beyond," she writes. World Labs believes that endowing machines (including robots) with such "spatial intelligence" could be transformative for a number of industries."

World Labs released Marble, a model that generates, reconstructs, and simulates full 3D environments from text prompts, images, videos, or coarse 3D layouts. Users can create interior or expansive exterior spaces through a web interface and refine scenes for realism and interactivity. Marble functions as a large world model that encodes spatial relationships and supports systems that perceive, model, reason about, and act within physical or geometric space. Spatial intelligence aims to enable new forms of storytelling, creativity, robotics, and scientific discovery. World Labs previewed Marble with creatives for feedback and positions spatial capabilities as transformative across industries.

Read at Fast Company