has anyone seen these staircase loss curves before and really figured out what's going on? my two leading theories are that the loss is getting averaged somewhere behind the scenes (don't know where) and that the data isn't shuffled between epochs. i'm using huggingface trainer.

→ View original post on X — @jxmnop