Don’t blindly trust everything you see on internet. 175B is the number of parameters in GPT-3 and not the amount of data and GPT-4 is rumoured to have 100T parameters. Personally 100T parameters doesn’t seem feasible with the current compute capabilities.
GPT-3 Parameters vs Data: Clarifying AI Model Rumors
By
–
Leave a Reply