3. Limit the number of predicted tokens When generating text, limit the number of tokens the model is allowed to generate. The longer the text generation process, the higher the risk of hallucination.

→ View original post on X — @saboo_shubham_,