4 ms·
Is Winter Coming? (2024)
- GaggiX 2y ago>Spring 2024 Reasoning models like o1 had not yet been released at that time. It's amazing how much progress has been made since then. Edit: also Search wasn't available as the blog mention "citation"s.
- netdevphoenix 2y agoThe point isn't that progress is not happening but that it's slowing down. You get more of the same, smaller memory footprint, faster responses, less hallucinations, etc. Significant progress would be another deep seek kinda of breakthrough, near 0% hallucination rate, performing like current models with less than half of their dataset, epistemological self awareness (i.e. I am not sure of the correctness of the answer I just gave you, ability to override assumptions from the training dataset, etc). We are just getting cars of different shapes and colours, with built-in speakers and radio. Not exactly progress
- GaggiX 2y agoReasoning models like o1 are on a whole new level compared to previous models, for example they are incredible at math, something that previous models struggled with a lot, this seems pretty huge to me as the performance of previous models was flattening, it's a kinda a new paradigm.
- eisfresser 2y ago> another deep seek kinda of breakthrough That was only six month ago. I don't think this is an argument that things are slowing down (yet).
- netdevphoenix 2y agoI didn't say that progress stopped only that it is slowing down (ie they become less frequent). Deep seek happening 6 months ago doesn't counter what I said.
- pixl97 2y ago>but that it's slowing down Progress isn't a smooth curve but more step like. Also, the last 10% of getting AI right is 90% of the work, but it doesn't seem to us humans. I don't think you understand the gigantic impact that last 10% is going to make on the world and how fast it will change things once we accomplish it. Personally, I hope it takes us a while. We're not ready for this as a society and planet.
- patapong 2y agoThis assumes that LLMs are only useful if they are AGI. I don't think we do - what we have today is already sufficient to unlock an enormous amount of value, we just haven't done so yet. Thus, I think we can compare them to electricity - a sophisticated technology with a ton of potential, which will take years to fully exploit, even if there are no more fundamental breakthroughs. But also not the solution to every single problem.
- zahlman 2y agoArguably, LLMs - or whatever systems succeed them - are only useful if they are not AGI. Given the evidence already collected about how willing humans are to make these systems "agentive", we pretty well have to worry about the possibility of an AGI using us instead. Even if there's some other logical barrier to recursive self-improvement ("hard takeoff") scenarios.
- empath75 2y agoThe consequences of a new thing being invented are not entirely dependent on progress of innovation in the thing itself. It takes quite a long time for people to build _on top of_ a new technology. LLMs could not appreciably improve at all, and we've still barely scratched the surface of applying what we have. Your car example is a perfect one -- society was _completely reordered_ around the car, even though the fundamental technology behind the car didn't change from the early 20th century until the invention of the electric car.
- netdevphoenix 2y agoSurely, finding new applications to existing tech can't be considered progress in the development of that tech
- Jedd 2y agoThat's also one of those things that would probably confuse LLMs as readily as it confuses North Americans (for much the same reason - training). Spring 2024 for me was from the 1st of September to the 30th of November.
- GaggiX 2y agoWhat's the confusion here? The author is from Sweden, also neither I nor the author are North Americans.
- barbazoo 2y agoOnly about 10% of earths population live in the southern hemisphere. It’s pretty fair to assume northern.
- Jedd 1y agoMaybe, but if you're trying to appear folksy by using region-dependent seasonal identifiers rather than, you know, dates AND you're happy that instantly means 10% of your readers will be confounded by that, then I guess go for it. I'll note that about 40% of the earth's population lives in the tropics, where seasons also don't break down the same way they do for the author - typically that demographic will recognise two identifiable seasons through the year.
- rgreeko42 2y agoo1 was not a major advancement
- decimalenough 2y agoI'm generally quite skeptical of AI, but this overstates its case. Two things stand out: > what LLMs do is string together words in a statistically highly probable manner. This is not incorrect, but it's no longer a sufficient mental model for reasoning models. For example, while researching new monitors today, I told Gemini to compare $NEW_MODEL_1 with $NEW_MODEL_2. Its training data did not contain information about either model, but it was capable of searching the Internet to find information about both and provide me with a factual (and, yes, I checked, accurate) comparison of the differences in the specs of the models as well as a summary of sentiment for reliability etc for the two brands. > Currently available software may very well make human drivers both more comfortable and safe, but the hype has promised completely autonomous cars reliably zipping about in rush hour traffic. And this is already not hype, it's reality anywhere Waymo operates.
- belter 2y agoWaymo operates on highly controlled and mapped environments. Can they handle Rome or Mumbai?
- decimalenough 2y agoDescribing SF's Tenderloin at night as a "highly controlled environment" would be stretching it. Anyway, you're moving the goalposts here. Waymo is operating at scale in actual human cities in actual rush hour traffic. Sure, it would struggle in Buffalo during a snowstorm or in Mumbai during the monsoon, but so do human drivers.
- hiatus 2y ago> Sure, it would struggle in Buffalo during a snowstorm or in Mumbai during the monsoon, but so do human drivers. We don't expect technology to be on par with human capabilities but to exceed them.
- colinmorelli 2y agoThis feels a lot like "moving the goalposts." First, it was complete science fiction to have technology in the car. Then, it was in the car, but it could only do navigation and music, it can't operate the car the way humans can. Then, it can prevent you from weaving out of your lane, and it can stop the car if you're about to crash into something, but it can't help you with your commute. Then, it can speed up, slow down, and steer on the highway, but it can't take you door to door. Now, it can take you door to door, but only in certain environments, it can't do it everywhere. All of the above happened over the last ~20 year or so. The progression clearly seems to point to this being more than hype, even if it takes us longer to realize than originally anticipated.
- Fraterkes 2y agoI love reading, I enjoy long-form articles, but I really wish technical bloggers especially would practice distilling their point into shorter posts. I notice it a lot with (older) scott alexander articles, this implicit assumption that your writing is informative/entertaining enough that you can stretch a simple idea to many pages. I want to reitterate that I don't want dull, minimal, writing. I don't subscribe to the "reduce your wordcount until it can't be reduced any further" style of writing advice. I just think that many people have very similar ideas about ai (and written very similar things), and if you have something to say that you haven't seen expressed before, it is worthwile (imo) to express it without preamble.
- keiferski 2y agoIronically this is one of the best use cases I’ve found for AI tools at the moment. Summarize and critique this argument in a series of bullet points. More seriously though, I think there is a lack of rigorous thinking about AI specifically and technology in general. And hence you get a lot of these rambling thought-style posts which are no doubt by intelligent people with something compelling to say, but without any fundamental method for analyzing those thoughts. Which is why I really recommend taking a course in symbolic logic or analytic philosophy, if you are able to. You’ll quickly learn how to communicate your ideas in a straightforward, no nonsense manner.
- SilverSlash 2y ago> Which is why I really recommend taking a course in symbolic logic or analytic philosophy, if you are able to. You’ll quickly learn how to communicate your ideas in a straightforward, no nonsense manner. Do you have any free online course recommendations?
- keiferski 2y agoI haven’t taken any online courses unfortunately (took them in person in college) but for symbolic logic I recommend the book by Klenk. I used that in my course and found it to be a good intro. There are a bunch of lectures on YouTube about analytic philosophy though, and from a quick look they seem solid.
- Havoc 2y agoThe hype cooling down a bit might not be a terrible thing
- lolinder 2y agoAn example of the prompt engineering phenomenon: my wife and I were recently discussing a financial decision. I'd offered my arguments in favor of one choice and she was mostly persuaded but decided to check in with ChatGPT to help reassure herself that I was right. She asked the financial question in layman's terms and got the opposite answer that I had given. She showed me the result and I immediately saw the logical flaws and pointed them out to her. She pressed the model on it and it of course apologized and corrected itself. Out of curiosity I tried the prompt again, this time using financial jargon that I was familiar with and my wife was not. The intended meaning of the words was the same, the only difference is that my prompt sounded like it came from someone who knew finance. The result was that the model got it right and gave an explanation for the reasoning in exacting detail. It was an interesting result to me because it shows that experts in a field are not only more likely to recognize when a model is giving incorrect answers but they're also more likely to get correct answers because they are able to tap into a set of weights that are populated by text that knew what it was talking about. Lay people trying to use an LLM to understand an unfamiliar field are vulnerable to accidentally tapping into the "amateur" weights and ending up with an answer learned from random Reddit threads or SEO marketing blog posts, whereas experts can use jargon correctly in order to tap into answers learned from other experts.
- bdangubic 2y agovery interesting - could you share your wife's and yours prompt to provide more concrete context?
- lolinder 2y agoI considered it, but given the personal nature of the topic I want to keep the details off the public internet. I realize that makes my observation less specific than it could be, but I think the result should be relatively unsurprising to anyone familiar with the tools—this is just a natural consequence of the way the stats fall out.
- xnorswap 2y agoUsing LLM's in any unfamiliar context is dangerous. When asking them anything, always follow up with: "Are you sure?". Far too often it'll cheerily apologise and correct their own answer.
- rvz 2y agoLet's just say that people once thought that Big Tech was once invincible, until it wasn't. Obviously those exposed in the AI hype will tell you that there is no winter. Until the music stops and almost little to no-one can make money out of this AI race to zero.
- dinfinity 2y ago> Let's just say that people once thought that Big Tech was once invincible, until it wasn't. Half the world runs on Big Tech. Some of them have cash reserves bigger than the GDP of sizeable countries. They lead in R&D investment: https://www.rdworldonline.com/top-15-rd-spenders-of-2024/ https://www.rdworldonline.com/top-15-rd-spenders-of-2024/ > Obviously those exposed in the AI hype will tell you that there is no winter. Go look at how much money was spent on AI R&D in the last AI 'summers' (and winters). Pennies compared to the billions and billions of dollars the private and public sector is throwing at it right now. Will some investments turn out to be a waste of time and money? Yes. Will investment be reduced to a fraction of what it is today? Hell no. The music stops when humans are economically obsolete.
- qudat 2y agoWhile reading this article, I kept asking myself the question: "Why can't LLM ask us follow up questions?"
- lblume 2y agoThey absolutely can if you prompt them to. You can even add it to your system prompt for it to happen in every new conversation!
- esjeon 2y agoAI winters will keep coming as long as the definition of AI stays relative. We used to call chess programs chess "AIs", but hardly anyone says that anymore. We call LLMs "AIs" now, but let's be real: a few decades from now, we'll probably be calling them token predictors, while some shiny new "AIs" are already out there kicking asses. At the end of the day, "AI" really just means throwing expensive algorithms at problems we've labeled as "subjective" and hoping for the best. More compute, faster communication, bigger storage, and we get to run more of those algorithms. Odds are, the real bottleneck is hardware, not software. Better hardware just lets us take bolder swings at problems, basically wasting even more computing power on nothing. So yeah, we’ll get yet another AI boom when a new computing paradigm shows up. And that boom will hit yet another AI winter, because it'll smack into the same old bottleneck. And when that winter hits, we'll do what we've always done. Move the goalposts, lower the bar, and start the cycle all over again. Just with new chips this time. Ah, Jesus. I should quit drinking Turkish coffee.
- antirez 2y agoOrthogonal: the lemons in the picture, from Palermo (Sicily), could not only being lemon or lemon-shaped soap, but also a sweet, our very famous "frutta martorana": https://en.wikipedia.org/wiki/Frutta_martorana https://en.wikipedia.org/wiki/Frutta_martorana
- osigurdson 2y agoA different kind of AI winter is already here. This "winter" is associated with companies laying people off and then lazily waiting around for AGI to emerge. This is leading to a kind of malaise that I think will ultimately be bad for economies. It is fine to use any available tool to boost productivity, but magical thinking is not sound management.
- wellUc 2y agoA predict a lot of circumlocutions about AI but most people not noticing since they blindly follow the TV/politics as-is anyway. A lot of people (still a tiny proportion of the population) will be loud in opposition but ultimately overwhelmed by the nihilism and indifference of the aggregate. The loudest will be those who perceive some loss to their own lifestyle that relies on exploiting other’s attention, as AI presents new risk to their attention grabbing behaviors. Then they will die off and humanity will carry on with AI not them. Circle of life Simba.
- tim333 2y agoWinter seems unlikely in the near term because we are around the level in the steady increase in computing power where it's around human level, like this cartoon https://x.com/waitbutwhy/status/1919870578502021257 https://x.com/waitbutwhy/status/1919870578502021257