bloep

3 ms·

1. 1.▲
   by bloep 4y ago

   You'd need something Spotify. Another similar possibility might be to do more RL with this data, e.g. using upside-down RL. One can possibly steer this with user feedback as well.
2. 2.▲
   by bloep 4y ago

   What I had in mind was kind of like a reward model that is trained by on longer outputs that have a very high similarity to training examples. Something similar has been done to prevent LLMs from using toxic language. You'd simply back
3. 3.▲
   by bloep 4y ago

   There are quite simple tricks to avoid repetition/copying in NNs, e.g. by (1) training a model to predict the "popularity" of the main model's outputs and penalizing popular/copied productions by backpropping throug
4. 4.▲
   by bloep 4y ago

   Indeed, there is lots of denial or ignorance in this thread (ignorance in the technical sense). AudioLM already produced impressive results and it's a tiny fraction of what is already possible because performance simply improves with s
5. 5.▲
   by bloep 4y ago

   Modern ThinkPads are unfortunately also not very repairable. Replacing the USB-C port on the X1 Carbon is a 1 hour Job. The RAM is soldered on. Replacing the keyboard requires disassembling everything. Replacement parts are prohibitively ex