xssfox (crossy)

@xssfox@cloudisland.nz

she/her

xssfox or crossy for short, is a Naarm (Melbourne Australia) based vixen who enjoys hacking on cloud infrastructure, radio hardware and software. She specializes in cursed software and horrible infrastructure. Notable works include BigBuckAWS, nr-basic, sondehub.org, ft8_beep and etch-a-tv.

Complaints department
+61390699433
ai, aipol

I wanted a way to visualize how enabling non deterministic output on LLMs (temperature and what you find on most public services) can have influence on the output. Being able to see "how likely was this to choose a different number and if so, what numbers" is a good way to judge trust (lots of asterisks here)

This little script takes a prompt, and then any time a number is encountered in the output reports the chances^1 of other numbers being reported, the continues on.

I'm just running a model that I can fit in my memory (qwen/qwen3.5-9b) so this isn't a demonstration of LLMs quality in general, just the concept that we could use to show/inform people of confidence(lots more asterisks here)

^1 This is using LLM Studios default Top P Sampling at 0.95

Provide a chocolate cake ingredient list using the following template: Flour: {} cups, Eggs: {}, Chocolate: {} g, Sugar: {} tsp, Butter: {}g, Milk: {}mL

The script shows the LLM trying various options of sizes of ingredients, sometimes there are 5 different numbers in the running
ALT
When was gay marriage legalised in Australia?

The LLM is generally pretty confident on years except for the Act year and the year the first marriages occured
ALT

Replying to an earlier post

re: aipol

@wren6991 @whitequark I've been thinking recently that nondeterministic token selection in public LLM services is part of a "Psychic Sports Picks"-like scheme^1. The randomness means that enough people get a good result to sustain the hype.

I've wanted to build a little toy LLM website where whenever a number is produced as outputs it let's you hoverover to see the other output options were possibly/likely.

^1: en.wikipedia.org/wiki/List_of_

en.wikipedia.orgList of scams - Wikipedia

Replying to an earlier post

PC GuideGoogle confirms Pixel 10 limits battery capacity after 200 charging cycles, and you can't do anything about itGoogle Pixel 10 supports Battery health assistance, but unlike previous generations, you can't turn off this battery throttling feature.