Not seeing why that's a problem w/ <= 5 classes since you can logit bias. The real issue is whether there's enough information left in the RLHF-flattened logprobs

→ View original post on X — @goodside