AI Dynamics

Global AI News Aggregator

About

Cosine Decay Implementation Bug in Training Loop

it's supposed to be cosine decay but this is just linear warmup and my thing is already broken

→ View original post on X — @jxmnop