I think what was meant is that you actually don’t need huge models to have great output. I mean, Mixtral8x7b easily beats 70b to 100b models. It all depends on the way models are trained and the trainingdata. And for the future years we need SMLs for having them on devices

→ View original post on X — @kimmonismus,