AI Dynamics

Global AI News Aggregator

About

Doubts About GPT-4 Parameter Count and Architecture Changes

Tweets like this are why I’m not totally convinced that GPT-4 is over a trillion parameters. I mean, maybe it is. Maybe it’s several trillion. But it also might be closer to 175B because of architecture changes.

→ View original post on X — @alliekmiller