sort of; i'm doing contrastive learning with large batches; at the end it's computed as cross-entropy, but this isn't a typical language modeling setup, i'm training an embedding model

→ View original post on X — @jxmnop