the hope is that “constrained distribution” is not quite the same as true OOD right like if i constrain decoding to valid json grammar, json is still within distribution, im just choosing a “top k” subject to my constraints

→ View original post on X — @swyx,