3 ms·
... and our judgments of composition favor recall over precision. Which is to say that as human judges we're good at finding sense in something generated if it'
by troelsSteegin 3y ago
... and our judgments of composition favor recall over precision. Which is to say that as human judges we're good at finding sense in something generated if it's plausible. We'll take a proposition (eg in a composition) and construct a justification for it. "I can see how that makes sense". I am conflating plausible combination with high recall. Precision, in this sense, is that no proposition would be acceptable without evidence or precedent. With all precision, no new idea is ok. So a "knob" for recall vs precision on a generative system would nice. Is "temperature" that knob?
- deleted 3y ago[deleted]
- b33j0r 3y agoThe very first python app I wrote was a statistical bard generator. I had python calculate word frequencies from a Shakespeare corpus and spit them back out with a probability distribution. Honestly it read just as well ;) We’re simpler than we imagine.
- Qem 3y ago> We’re simpler than we imagine. Indeed, creativity (not just randomness) is a quite high bar, that I think even most humans don't pass. Most of us don't create a lot of new things and ideas in our daily lives. We mostly follow the steps of those that came before them, with small adjustments here and there.
- b33j0r 3y agoRecombination makes dna and rna every day. Our limitation in seeing this is our short and fleeting lives. There is a pub:grill in Tempe called monkeypants. Is that a new idea or just clever?
- dontupvoteme 3y agoIt's random-ish and "novel", but that could very easily be a reddit username from years ago.
- b33j0r 3y agoHaha this thread has gotten too deep, but I appreciated your accurate addition with a lol!
- shrimpx 3y agoBtw Andrej Karpathy builds a Shakespeare LLM here: https://www.youtube.com/watch?v=kCc8FmEb1nY https://www.youtube.com/watch?v=kCc8FmEb1nY