"Efficiency Misnomer" is one of those papers that never gets old. It's hard to compare models from the viewpoint of one single cost indicator(either FLOPs, number of parameters, speed(throughput)). A model that has fewer FLOPs or fewer trainable parameters may still be

→ View original post on X — @jeande_d