3 ms·
> . If you have a way of detecting a good song, or at least filtering out rubbish, then you can generate thousands of attempts to get the good result. So often
by teruakohatu 5y ago
> . If you have a way of detecting a good song, or at least filtering out rubbish, then you can generate thousands of attempts to get the good result.
So often the filtering technique is a human in the loop, manually going through the output. Humans become the hidden, undifferentiatable and undisclosed loss function.
- sillysaurusx 5y agoSure is! And you'd often be amazed at just how much data you can churn through, if you put your mind to it. I once watched Gwern classify thousands of poetry outputs over the course of a day or two, with nothing more than dedication and a bash script to mark "a" or "b". It took a long time to accept that this is both normal and effective. It's not some hidden secret to be ashamed of. The headline images in https://openai.com/blog/dall-e/ https://openai.com/blog/dall-e/ are probably the best and most interesting images they could find; they were picked out by humans. It's a positive statement to say that dall-e can do that some of the time, rather than "it fails X% of the time."