Noise, seed, and the melody: a tiny prompt experiment

Some might describe temperature as “noise”, even without diving deep in to metaphysical metaphor, but that is not what it is.

It affects sampling, the promotion or demotion of “good”, otherwise directly from the values of logits, the certainty and perplexity of which are by the quality of the model.

The randomness internally is picking a random point in that distribution that may result in a likely or less likely token. Then, that the tokens need to be of good language-like thoughtful quality, the “large” part of LLMs.

There is a concept of “seed”, even a Chat Completions parameter. It controls the instantiation input point of the pseudorandom algorithm. With AI models now non-deterministic between runs, a seed cannot replay the same output identically, even with the same randomess being reused. So it is not the “seed of an idea”.

You can certainly inspire a model to wax poetically or fictionally with messages, direct or confusing. “seed” is language that needs a sensible AI powered completion.

You also can get creativity devolving into nonsense with higher temperatures, where the AI has the concept it should be writing about (and pattern which it tries to persist in writing) fractured by unlikely tokens.

You create three short poems, metaphorical allusions on a theme of robots in love.

Through astral gauges bypass cold scherm-curtail , Love writes logic that no fear unveil; Great iron joints in warmly bent flight — Their steel-hard bidھرuyến cir财经 broader 银河 cidadão respondió adapt slot emerged told heartbeat quiet touch journeys weacrib dẫn anew-front-per five-colored hail() paint dreaming}.realm had അട humm saddened full…