3 ms·
How might one be able to use human rating data to inform transformers? Like, if the outputs are shown 3 at a time to users and the user chooses the best, how to
by dr_dshiv 5y ago
How might one be able to use human rating data to inform transformers? Like, if the outputs are shown 3 at a time to users and the user chooses the best, how to create a feedback loop based on this labeled data? Or, if large numbers of output images/texts are individually rated on a scale of 0-10 by aesthetic beauty—-how might this be fed back to the transformer?
- robbedpeter 5y agoYou could use this to create a heatmap of an image to identify regions that would be rated as "beautiful," at the pixel level. You could then use that to inform a gan, iteratively modifying the image to whatever parameters you've trained the transformer to look for, gradually beautifying the image. Instead of beauty, you could use this for a Clip type model, judging quality and accuracy of the output, using the model to guide the training of a Dall-E style model. There are some obvious applications in trading, creating a model that incorporates multiple time frames and text feeds. This paper is pretty cool!