Tweets like this are why I’m not totally convinced that GPT-4 is over a trillion parameters. I mean, maybe it is. Maybe it’s several trillion. But it also might be closer to 175B because of architecture changes.
Doubts About GPT-4 Parameter Count and Architecture Changes
By
–
Leave a Reply