AI Dynamics

Global AI News Aggregator

About

Pretraining and Finetuning Outperform Algorithm Discovery in AI

AI has crushed it since this post way beyond expectation. I made the same category of mistake all of AI was making, of thinking we have to discover and write the algorithm. You don't. You pretrain and then finetune a BIG neural network on lots of tasks and it just falls out. lol.

→ View original post on X — @karpathy