Interactive LLM decoding strategies LLM sampling is a cool app that shows the effect of temperature, top K sampling, top P sampling, etc. on the probability distribution outputted by an LLM. LLM sampling: https://
artefact2.github.io/llm-sampling/i
ndex.xhtml
…
Interactive LLM Decoding Strategies and Sampling Effects
By
–
Leave a Reply