True, I mean VLMs to manipulate the scene graphs effectively. In my input example on the left – it took a lot more prompting and iterating with Claude to construct and animate the scene I wanted in threejs. Still, faster than doing it by hand.
@bilawalsidhu
-
Roblox leverages AI-assisted vibe coding for development
By
–
Roblox has a ton of advantages and is doing some cool stuff with the scene graph centric approach, not to mention leaning into vibe coding https://t.co/Yx9CnBPY7C
— Bilawal Sidhu (@bilawalsidhu) 2 février 2026Roblox has a ton of advantages and is doing some cool stuff with the scene graph centric approach, not to mention leaning into vibe coding
-
Technical challenges in VLM spatial reasoning and 3D scene graphs
By
–
Thanks. Another missing piece for now is VLMs having the spatial reasoning to manipulate 3d scene graphs effectively. But that hill is actively being climbed by the labs and is a matter of time.
-
NVIDIA Cosmos and Omniverse AI Integration
By
–
Totally. NVIDIA cosmos is attempting this to pair it with Omniverse as the engine – quality isn’t there yet but they’re pushing.
-
User request for expanded multimodal input in Genie AI
By
–
Very doable! Tho I wish genie would just accept video input and multi view images too https://t.co/Z05LOz9lVV
— Bilawal Sidhu (@bilawalsidhu) 2 février 2026Very doable! Tho I wish genie would just accept video input and multi view images too
-
Integrating Generative AI with 3D Scene Graphs and Engines
By
–
Much debate over Genie vs 3D engines. You can have both – the control of 3D scene graphs + the creativity of generative ai. Wrote this in 2024 breaking down the vision. The models are almost there. Now just imagine if Unreal / Unity productized this.
-
Explicit 3D Control Meets Generative AI in Virtual Production
By
–
Exactly this. It’s the future of virtual production and gaming. Explicit control of 3D scene graphs + implicit creativity of generative models. Been hammering this since 2023. Only now are models getting good enough to realize it. Y’all should build it!
-
Moltbook Metaverse: The Meta Evolution of Virtual Worlds
By
–
The moltbook metaverse – now that is getting pretty damn meta
-
MoltBook AI Swarm Agents Mirror Human Collective Nature
By
–
the other thing about moltbook – people aren’t really talking about these agents as individuals. they’re talking about it as a collective – almost like this ai swarm of agents coming to life. which honestly resonates because it holds a mirror to our own humanity. it’s
-
Jet Pack Genie: Amusing AI Spawn Glitches
By
–
The occasional jet pack genie spawns (sometime sans the actual jet pack) is really amusing