4 ms·

I’ve tried to dig a bit through the libgen fiction archive. Surprising to me, I found that the vast majority was Romance novels. I’ve since heard this from othe

I’ve tried to dig a bit through the libgen fiction archive. Surprising to me, I found that the vast majority was Romance novels. I’ve since heard this from others too that most published books are Romance. If this collection is trying to solve the problem of having large tagged and sorted data for training, even if it can’t be commercialized, it might also be introducing another where the data still needs to be weighted and filtered. Not to knock on Romance specifically but even training on all scientific papers ever written, whether peer-reviewed, highly cited, retracted, debunked, etc. might explain some hallucinations it ends up making.

kelsey9876543 3y ago
humans daydream about romance, why can't computers?
- PrayagBhakar 3y ago
  I don’t think it’s as much about day dreaming but more so about garbage in, garbage out. We know LLMs perform way better when you use high quality input data [0]. Having your input data be skewed towards one genre isn’t great. And thats not even getting into the quality of these books. [0] https://arxiv.org/abs/2306.11644 https://arxiv.org/abs/2306.11644
- GTP 3y ago
  Humans don't daydream about dating a computer, why should a computer daydream about dating a human? ;)
  - deleted 3y ago
    [deleted]
  - candiodari 3y ago
    Because that will sell.
jhbadger 3y ago
And not just romance in the mainstream Harlequin mode -- there's huge amounts of basically text porn there which shows up often in searches for something else. I didn't know this was still being written -- I thought film and Internet video had killed off the "dirty book" decades ago.
- dacryn 3y ago
  if anything internet made textual dirty stories explode as well. It's just a different target audience. Especially women don't like the highly visual stuff. They tend to favor a relaxing text.
- schleck8 3y ago
  These are called smut now and most of the readerbase is female. I believe it's often regarded a more "socially-aligned"/less hardcore porn substitute. https://www.urbandictionary.com/define.php?term=Smut https://www.urbandictionary.com/define.php?term=Smut
- globular-toast 3y ago
  How did you miss Fifty Shades of Grey?

kelsey9876543 3y ago

humans daydream about romance, why can't computers?

PrayagBhakar 3y ago
I don’t think it’s as much about day dreaming but more so about garbage in, garbage out. We know LLMs perform way better when you use high quality input data [0]. Having your input data be skewed towards one genre isn’t great. And thats not even getting into the quality of these books. [0] https://arxiv.org/abs/2306.11644 https://arxiv.org/abs/2306.11644
GTP 3y ago
Humans don't daydream about dating a computer, why should a computer daydream about dating a human? ;)
- deleted 3y ago
  [deleted]
- candiodari 3y ago
  Because that will sell.

jhbadger 3y ago

And not just romance in the mainstream Harlequin mode -- there's huge amounts of basically text porn there which shows up often in searches for something else. I didn't know this was still being written -- I thought film and Internet video had killed off the "dirty book" decades ago.

dacryn 3y ago
if anything internet made textual dirty stories explode as well. It's just a different target audience. Especially women don't like the highly visual stuff. They tend to favor a relaxing text.
schleck8 3y ago
These are called smut now and most of the readerbase is female. I believe it's often regarded a more "socially-aligned"/less hardcore porn substitute. https://www.urbandictionary.com/define.php?term=Smut https://www.urbandictionary.com/define.php?term=Smut
globular-toast 3y ago
How did you miss Fifty Shades of Grey?