3 ms·
Thinking of things a bit more broadly than just AI safety, imagine I'm training an LLM. I have 200 thousand ebooks, 1 million arXiv papers, 7 million Wikipedia
by michaelt 2y ago
Thinking of things a bit more broadly than just AI safety, imagine I'm training an LLM. I have 200 thousand ebooks, 1 million arXiv papers, 7 million Wikipedia articles, 300 million Reddit posts, and 500 billion Twitter posts.
If my LLM merely holds up a mirror to society, its output should be a tweet with a trace amount of reddit post mixed in.
Any time an LLM produces more than 140 characters of output, it's because someone like me has decided some data sources are more worthy than others.
That's inherently political, from a certain angle. But it's also important, if you don't want your LLM to advise people to put glue in their pizza sauce.