4 ms·
Even monolithic training runs take sources more disparate than any human has the capacity to consume. Also, given the lack of imagination everyone has with nam
by ben_w 2y ago
Even monolithic training runs take sources more disparate than any human has the capacity to consume.
Also, given the lack of imagination everyone has with naming places, I had to check:
https://en.wikipedia.org/wiki/Moscow_(disambiguation) https://en.wikipedia.org/wiki/Moscow_(disambiguation)
- stoniejohnson 2y agoI was responding to the idea that an LLM would believe (regurgitate) untrue things if you pretrained them on untrue things. I wasn't making a claim about SOTA models with gigantic training corpora.