The amount of non-deterministic behavior LLMs introduce makes me believe in techno-sorcery futures. Let's chant a verse, burn candles, perform data prayers and result purification rituals. Anything to get this endpoints perform predictable across different input
LLM Non-determinism and Endpoint Predictability Challenges
By
–