Meta presents Layer Skip – up-to 200% fast inference > Applies layer dropout: low rates for early layers, high rates for later layers
> Uses early exit loss with shared exit for all transformer layers Inference: > Increases early exit accuracy without auxiliary layers
>

→ View original post on X — @reach_vb,