You are right. Hallucination is a feature actually and focusing on it may hurt creativity and all the quirks we get from LLMs. It's a tricky balance. We want LLMs to produce things that amaze us, but we also don't want them to make confusion about factual world knowledge.

→ View original post on X — @jeande_d