4 ms·
I kinda like this but e.g are research papers fact or fiction? How about an economics textbook, or an article in the economist? "A history of the english speak
by xyzzy123 3y ago
I kinda like this but e.g are research papers fact or fiction?
How about an economics textbook, or an article in the economist? "A history of the english speaking peoples" by Winston Churchill?
If we restrict to "ground truth we feel very sure about" it feels like available training data might be quite small.
- deleted 3y ago[deleted]
- immibis 3y agoand what if the economics textbook contains "much like Charmander evolves into Charizard, free markets evolve into monopolies"?
- jameshart 3y agoRight. A lot of the magic of LLMs probably comes from the broader appreciation of language and cultural reference that they get from being trained on a diverse corpus, rather than just a bunch of dictionaries and reference books. And anyway - answers to all my ‘fictional facts’ questions above can be sourced from Wikipedia - there’s tons of made up stuff on there.
- BugsJustFindMe 3y agoHopefully such statements are sufficiently rare that they don't get reinforced, I guess. I don't know. A very real problem occurs with people too when fictional things are repeated often enough without direct mention of their fictional nature.