AI Dynamics

Global AI News Aggregator

About

Architectural Cleverness Cannot Compensate for Raw Scaling Gap

http://
incompleteideas.net/IncIdeas/Bitte
rLesson.html
… is about the surprisingly limited impact of architectural cleverness versus raw scaling. I am analogizing to suggest that a radical hardware architecture like https://
en.m.wikipedia.org/wiki/Cerebras probably won’t make up for being back a few stages, but hope springs

→ View original post on X — @id_aa_carmack