4 ms·
What we are discovering in the behavior of LLMs is that the corpus of material to train from is very much a product not of what Marc Andreessen calls "the woke
by Zigurd 4y ago
What we are discovering in the behavior of LLMs is that the corpus of material to train from is very much a product not of what Marc Andreessen calls "the woke mind virus," but the opposite: We are awash in previous decades' attitudes toward women, minorities, and conformist America assumptions about how things should be, and LLMs dutifully, mechanically, "learn" from this corpus.
You and I know to view such material with appropriate skepticism. How do you train an LLM to know "it was the '70s and you could say things like that about gay people then, but not today."
What Elon wants is to be able to say stuff he could say when he was 20. He thinks that's closer to truth.