have no idea about meta specifically, but the same thing is happening at ALL tech companies they’re running out of ideas to improve the models, can’t 10x the amount of text written by humans, can’t afford to 10x training compute again this next year is gonna be interesting

→ View original post on X — @jxmnop