Pregen + prompt with a sample sounds like a good workaround to me; just pregen a lot so you don’t mind the diversity. You could even pregen from a base model and count frequency so common greetings are common.

→ View original post on X — @goodside