all the experiments in the paper approximate Hᴷ(x | θ) using bits under arithmetic coding, which is equivalent to cross-entropy here Hᴷ(x) is approximated using the formula for entropy of random uniform distribution for synthetic, and AC/xentropy of 'reference model' for text

→ View original post on X — @jxmnop