Great point. We are seeing more and more than smaller models with better objectives or data can beat big ones! My main point is that an approach shouldnt go away as models get better. Scale is just one way of getting better
By
–
Great point. We are seeing more and more than smaller models with better objectives or data can beat big ones! My main point is that an approach shouldnt go away as models get better. Scale is just one way of getting better