— Latent.Space (@latentspacepod) 25 juin 2023
GPT4 is 8 x 220B params = 1.7 Trillion params https://
x.com/soumithchintal
a/status/1671267150101721090?s=20
… ok I wasn't sure how widely to spread the rumors on GPT-4 but it seems Soumith is also confirming the same so here's the quick clip! so yes, GPT4 is technically 10x the size of GPT3, and all the small