Under the hood, Fable generates the world with ThreeJS, and GPT-Realtime-2 lets the kid answer out loud, ask questions, etc. As you can see, there are still small issues and paper-cuts throughout (it's a POC!), but the possibility of what this could become is absolutely insane!

→ View original post on X — @mattshumer_