oh ok we are focusing on different things – yes hybrid with some full attention is impt. but yea like i said its gotten more mixed over time and lets call it “transformers is all you need” has gone from 100% relevant in 2022 to maybe like 70% now and i think almost every single

→ View original post on X — @swyx,