My skepticism about scaling deep learning is shared by many old fashioned AI people, but it’s likely wrong. Perhaps there is a master algorithm hidden in the training data? Perhaps we can distill it? And if not, there are many ways in which a dumb AI can learn to improve itself.

→ View original post on X — @plinz