ai, aipol
I wanted a way to visualize how enabling non deterministic output on LLMs (temperature and what you find on most public services) can have influence on the output. Being able to see "how likely was this to choose a different number and if so, what numbers" is a good way to judge trust (lots of asterisks here)
This little script takes a prompt, and then any time a number is encountered in the output reports the chances^1 of other numbers being reported, the continues on.
I'm just running a model that I can fit in my memory (qwen/qwen3.5-9b) so this isn't a demonstration of LLMs quality in general, just the concept that we could use to show/inform people of confidence(lots more asterisks here)
^1 This is using LLM Studios default Top P Sampling at 0.95

