4 ms·
I think the title is intentionally inflammatory, but I do think we need more criticism. We have a group of people trying to convince the world that LLMs may po
by bearjaws 2y ago
I think the title is intentionally inflammatory, but I do think we need more criticism.
We have a group of people trying to convince the world that LLMs may possibly (it could be 50+ years away!!) turn into AGI.
We have all these impressive benchmarks "WOW 91% in MathEval!!!" but go ahead and use the OpenAI API to do y=mx+b and watch it completely fail at any number over 4 digits.
We have the coding benchmarks, but watch it still use var instead of let.
All the numbers are going up, but it still feels primitive and cannot be trusted. This is almost 2 years later this point.
We've got people bolting on a dozen other solutions to make LLMs work, theres probably tens of millions of LOC now written to make LLMs functional in apps, so much for reducing engineering jobs.
IMO look at machine vision, we thought we were 5 years away from autonomous driving 15 years ago. It's still evolving and the tech only partially uses machine vision. Meanwhile its revolutionized dozens of other industries. Same is happening with LLMs.
- FabHK 2y agoThe title is not inflammatory, but (granted) easily misunderstood. "Bullshit" is a term of art in philosophy, coined by philosopher Harry Frankfurt (1929-2023) in his 2005 booklet On Bullshit, in which he distinguishes bullshit from lies: > The liar cares about the truth and attempts to hide it; the bullshitter doesn't care if what they say is true or false.
- dvfjsdhgfv 2y ago> We've got people bolting on a dozen other solutions to make LLMs work, theres probably tens of millions of LOC now written to make LLMs functional in apps, so much for reducing engineering jobs. To be fair, in my niche at least I can get a better result by querying ChatGPT4 than StackOverflow. When you take into account that the replies are often mistaken, outdated etc., it becomes just another tool to use form time to time when you need it.
- meiraleal 2y agoIt doesn't make sense to criticize an elephant for not knowing how to climb a tree. LLMs can do absurdly impressive things. It is so impressive that we expect it to perform the same way with any thing we throw at them. That's an absurd expectation.
- bearjaws 2y agoThat is not how they are being sold. We have people saying they will be AGI in just 3 years. They are sold to do programming, drug synthesis, general reasoning, pass the bar exam, etc... It cannot do any of these things even competently, but it does do other things like proof reading and modification of educational content very well.
- i5heu 2y agoI think they are sold here as bullshit right? What purpose does it serve you to take anyone serious?