What is a model hallucination? Model hallucinations are when you ask a factual question, like "how many dogs are in the state of Illinois in the United States?", and the model generates something that appears to be a potentially valid answer but is entirely made up.