You can argue that bio brains have vastly more weights that are mostly sparse, because the space of neurons that could have been connected to is very large, with synapses exploring and getting pruned. Simulating bio connectivity would be expensive on GPUs! Bio neurons look good

→ View original post on X — @id_aa_carmack