4 ms·
> There's no real edge to it. Yes, as if it is in some weird hidden dimensional sense completely uniform. ETA: suddenly reminded of the Bateson quote about in
by dofm 2mo ago
> There's no real edge to it.
Yes, as if it is in some weird hidden dimensional sense completely uniform.
ETA: suddenly reminded of the Bateson quote about information being “the difference that makes a difference”.
- fwip 2mo agoThat checks out, right? We're instructing LLMs to choose from the least "surprising" tokens at each step (modulo some temperature). It feels smooth, slippery - no friction to the eyes that glaze over as they skim the text, and no bumps to snag in your memory. Like waking from a dream, recalling only the barest shapes of a few concepts or themes, until it vanishes with your morning coffee. The examples I've seen of AI music (though I avoid it on principle) seem the same.