"Parcae Scaling Laws For Stable Looped Language Models" LLMs usually scale with more parameters or more data. But this paper scales a new axis for transformers through recurrence. So instead of making the model bigger, it reuses the same Transformer layers multiple times.
Parcae Scaling Laws: Recurrence Approach for Stable Language Models
By
–
