I also went on a podcast recently @latentspacepod with @swyx and talked about a bunch of stuff related to model architectures. Check it out here:

→ View original post on X — @yitayml