In just a few years, cutting-edge models have gone from using millions of parameters to trillions. The amount of computation used to train the largest AI models has increased by nine orders of magnitude. Here's what we should do next:
AI Models Scale Exponentially: Trillions Parameters Nine Orders Magnitude
By
–
Leave a Reply