6 ms·
> And we’re about to plug them straight into critical business flows? Anyone who thinks this is a problem has never managed flesh-and-blood employees, and espe
by blagie 4y ago
> And we’re about to plug them straight into critical business flows?
Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. LLMs don't need to be perfect. The bar they need to meet for a lot of work is just not very high.
We're also about a year or two into LLMs, and their capabilities are still increasing rapidly. We don't know where their ceiling is. They might plateau where they are, improve slowly, improve linearly, follow Moore's Law, or head off for singularity.
- l33t233372 4y agoWe are not “a year or two into LLMs”. To name one example, BERT is more than 5 years old.
- FeepingCreature 4y agoIs 110 million parameters really a "large" language model though? Especially since the models gain novel skills as they scale up.
- srcreigh 4y agoSo if a new model is trained with 10x parameters of gpt3, is gpt now no longer an llm?
- blagie 4y agoIt's a little bit weird. In semiconductors, we ran into the same problem. "large scale integration" happened at 500 transistors, and "very large scale integration" at 20,000. For a while, "ultra large scale integration" happened at a million and more qualifiers were added, until everyone decided it was ridiculous, and we went back to VLSI. From my perspective, LLMs are about where the language models start to behave in ways which feel sentient and replace mainstream human tasks, such as making first drafts of emails, code, or legal filings. That breakpoint was around GPT-3. I can't predict the future. When we have 3T parameter models, we might: - Call them LLMs, and group them with GPT-3 - Call them LLMs, but shift the goal posts to where GPT-3 is no longer one - Call them VLLM - Call them AGI However, what's clear to me is that state-of-the-art models with e.g. 3B parameters are qualitatively different from GPT-3 and friends. I don't consider those to be LLMs.
- not_a_shill 4y agoNah, the new ones can just be called Xllms. Then we can just keep adding Xs every generation.
- eyelidlessness 4y ago> Anyone who thinks this is a problem has never managed flesh-and-blood employees, and especially not minimum wage ones. I’ve worked with minimum wage employees. I’ve even worked with people who insist against all evidence and questioning that basic facts about reality like the year are contrary to known reality. I’ve never in my now very aging career worked with any such person who can influence billions of people by interaction on a tremendously popular website.
- hef19898 4y agoI worked with people ranging from minimum wage to absurd salaries, read SVPs. And the latter group was by far more prone to ignore the actual year, color of the sky or wether water is wet than the former. The former is usually also better at following basic instructions and processes. Judging from where I stand atm, I guess the SVP kind of functions are easier to replace by ChatGPT (writting pointless emails ignoring simple facts for example) than the minimun wage work involving actual work (solving invoice problems or moving stuff reliably from A to B).
- kevviiinn 4y agoActual value has always been created by the workers not the capital holding class, so that makes sense
- lonelyasacloud 4y agoPerhaps not minimum wage employees, but there have certainly been plenty of politicians who have spouted far worse.
- selestify 4y agoThey literally didn't know what the current year was? Were they high and/or mentally disabled?