i've basically come full circle and now think that the scale maximalism is the right way to think about AI until we scale the parameter count of our models, we will only see incremental improvement everything else is just cope while we wait for better GPUs & bigger datacenters
Scale Maximalism: Why Bigger AI Models Drive Real Progress
By
–