3 ms·
So what problems do language models solve to a human-like level or higher? I think answering that question should be required as part of any claim that a syste
by FartyMcFarter 4y ago
So what problems do language models solve to a human-like level or higher?
I think answering that question should be required as part of any claim that a system is an AGI or nearly there.
- make3 4y agohttps://arxiv.org/abs/2109.01652 https://arxiv.org/abs/2109.01652 https://arxiv.org/abs/2206.04615 https://arxiv.org/abs/2206.04615
- dinosaurdynasty 4y agoThey're (probably) better than humans at text prediction https://www.lesswrong.com/posts/htrZrxduciZ5QaCjw/language-models-seem-to-be-much-better-than-humans-at-next https://www.lesswrong.com/posts/htrZrxduciZ5QaCjw/language-m... (which is what they are trained on, so maybe not unreasonable). There's also the idea that GPT-3/etc can produce text that's difficult for humans to distinguish from human-generated text at the lowest levels of quality (think like time cube), which is closer to AGI than say simplistic Markov generators. (How close is anyone's guess)