Why the Same Model Almost Never Gives the Same Answer Twice
Same prompt, same model, twice, two different answers. Not a bug: the model draws from a probability distribution at every word. What temperature, top-p, and top-k actually set.
Same prompt, same model, twice, two different answers. Not a bug: the model draws from a probability distribution at every word. What temperature, top-p, and top-k actually set.