AI Dynamics

Global AI News Aggregator

Restarting Cosine Schedule at Epochs or Checkpoints

By

@rasbt

–

That's actually a good point. But it would be quite trivial to restart the cosine schedule after each ~epoch or checkpoint

→ View original post on X — @rasbt,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *

MORE ARTICLES