15 ms·
Many in the AI field think the bigger-is-better approach is running out of road
- di456 3y agoNo surprise. Scale vertically first, then horizontally
- CrzyLngPwd 3y agohttps://archive.is/XwWTi https://archive.is/XwWTi
- deleted 3y ago[deleted]
- jug 3y agoI also heard this. I unfortunately forget which study it was but yes, their paper spoke of likely diminishing returns at least at around 400-500B parameters for current LLM's. The recent news of GPT-4 running on 8x 220B LLM's (which doesn't equal a 8*220B size) fits that range and it's also questionable how much further we can push LLM's further by introducing multiple models like this, because this too eventually introduces problems due to granularity and picking the right model if I understood this correctly (from an earlier Hacker News discussion). (sorry for altogether no sources lol)
- whimsicalism 3y agoHave those reports from George Hotz been confirmed? It seems plausible to me, but also suggests to me that we have further to go by using that parameter budget for depth rather than for width.
- woeirua 3y agoIt seems consistent with the behavior we see when using GPT4 in chat mode. Every once in a while it will change its answer as it’s generating it, as though it’s switched which model it favors to produce the response. GPT3.5 doesn’t do that.
- famouswaffles 3y agoMoE models don't work like that though
- SgtBastard 3y agoToken-at-time MoE models could result in mid-output-stream directional change. I agree with you that whole-output MoE models don’t.
- letitgo12345 3y agoSeveral people in the community have confirmed it so while we don't "know know", it does seem like the dominant plausible rumor going around
- awestroke 3y agoIt's been just a few months since GPT4. Calm down.
- codetrotter 3y agoMajor AI winter #3. Let's gooo!
- seydor 3y agohopefully it will last as long as an actual winter
- pimpampum 3y agoReally, looks like our expectations are doubling every 6 months. This question needs a little more exploring, although it's bound to happen somewhere and we'd love believing we are close to the maximum possible.
- _kava 3y agoNon paywall: https://archive.ph/XwWTi https://archive.ph/XwWTi Imo, it is true that the current architecture is hitting the limit. We need a breakthrough on the scale of the transistor to get past this problem. We know it is possible though. Every single human is proof that high performance AI can be run with less energy than a laptop. We just need a dedicated architecture for their working mechanisms the same way a transistor is the embodiment of 1 and 0. Unfortunately, in terms of understanding intelligence and how they work, I don't think we have made any significant advance in the last few decades. Maybe with better tools at probing how the LLM work, we can get some new insights.
- whimsicalism 3y agoData requirements are overstated - you can train on longer and longer sequences and I am pretty sure most organizations are still using the “show the model the data only once“ approach which is just wasteful. Compute challenges are more real, but we are seeing for the first time huge amounts of global capital being allocated to solve specifically these problems, so I am curious what fruit that will bear in a few years. I mean already the stuff that some of these low level people are doing is absolutely nuts. Tim Dettmers work training with only 4 bits means only 16 possible values per weight and still getting great results.
- nextworddev 3y agoYep. We are in the very early innings of capital being deployed to all this.
- sgt101 3y agoOk - what's the ROI on the $10bn (++) that OpenAI have had? So far I reckon <$10m in actual revenue. This isn't what VC's (or microsoft) dream of.
- nextworddev 3y agoI think Azure OpenAI service is growing at 1000% per quarter according to last earnings call
- TeMPOraL 3y agoIndeed. Azure OpenAI service is how you get corporate-blessed ChatGPT that you can use with proprietary information, among other things. There's a huge demand for it.
- Quarrelsome 3y agoThe level of exposure since chatGPT has/will result in a lot of money turning up, especially for applications of the existing technology (whether they succeed or fail). That stats on usage demonstrate that the thundering herd has noticed and that attention can be extremely valuable. I think its quite likely that OpenAI will make that money back and more, as both the industry leader and with the power of their brand (chatGPT).
- Animats 3y agoWe need a way to make tight little specialist models that don't hallucinate and reliably report when they don't know. Trying to cram all of the web into a LLM is a dead end.
- z3c0 3y agoLogistic Regression is simple to implement, supports binomial, multinomial, and ordinal classification, and is a key layer in NN, as it's often used as an actuator that sorts a probability into a discrete category. Very good for specialized problems, and easily trainable to sort unknown or nonsensical inputs into a noncategory. Linear Regression is great for projections, and can even be fit to time series data using lagging.
- rco8786 3y agoBingo. I've been beating this drum since the initial GPT-3 awe.. The future of AI is bespoke, purpose-driven models trained on a combination of public and (importantly) proprietary data. Data is still king.
- JimtheCoder 3y agoSo, search isn't dead after all...
- stavros 3y agoSearch has definitely been dead since before LLMs, we just don't have a replacement yet.
- JimtheCoder 3y agoI mean more the concept of search, not the current implementation
- stavros 3y agoOh, I don't think we'll ever stop wanting to search for things. Maybe not everything, but some things.
- bluecoconut 3y agoAnother recent (but not called out in this article) is the "Textbooks Are All You Need" paper [1]; the results seem to suggest that careful curation and curriculums of training data can significantly improve model capabilities (when training domain specific, smaller models). Claiming a 10x smaller model can outperform competitors. (Eg. phi-1 vs. starcoder) [1] https://arxiv.org/abs/2306.11644 https://arxiv.org/abs/2306.11644
- TaylorAlexander 3y agoI’ve still wondered if anyone has tried training with a large dataset of published books, like something from library genesis, or in the case of google using the full text from google books. There’s all this talk of finding quality text and I’ve not heard of text from print books being a major source beyond this textbooks paper?
- startupsfail 3y agoThat’s how OpenAI was (is) doing it. Books downloaded from the Internet is a part of the dataset as per GPT3 model card. Right to read.
- YetAnotherNick 3y agoTBH, it looks like metric manipulation to me. They have used GPT-3.5 to generate their data(and not use textbooks at all like the title suggests). And their dataset is very much like their benchmark data. While there was some filtering, but still it is very possible that lot of the benchmark questions were in training data. We likely wouldn't ever know how good the model is as it not only closed but they haven't provided access to anyone.
- bluecoconut 3y agoThey seemed to be pretty mindful of this contamination, and call out that they agressively pruned some training dataset and still observed strong performance. That said, I agree, I really want to try it out myself and see how it feels, and if the scores really translate to day-to-day capabilities. From section 5: In Figure 2.1, we see that training on CodeExercises leads to a substantial boost in the performance of the model on the HumanEval benchmark. To investigate this boost, we propose to prune the CodeExercises dataset by removing files that are “similar” to those in HumanEval. This process can be viewed as a “strong form” of data decontamination. We then retrain our model on such pruned data, and still observe strong performance on HumanEval. In particular, even after aggressively pruning more than 40% of the CodeExercises dataset (this even prunes files that are only vaguely similar to HumanEval, see Appendix C), the retrained phi-1 still outperforms StarCoder.
- LeanderK 3y agoTo the outsider it might seem that the only thing we've been doing is scaling up the neural networks, but that's not true. A lot of innovation and changes happened, some enabled us to scale up more and others just improved performance. I am quite confident that innovation will continue.
- jgalt212 3y agoYour statement is entirely fair, but the actual title is "The bigger-is-better approach to AI is running out of road". They are actually saying what you are saying, but your comment seems to contest the article.
- satellite2 3y agoHow is the economist qualified to answer this question?
- JimtheCoder 3y agoUsing this logic, how are they qualified to answer 90% of the questions their articles deal with...
- satellite2 3y agoYes and no. Most questions they answers are more politically leaning, meaning that they are not optimisation problems but they answer the question of the kind of society we want to be. This specific article seems to be reporting on a very technical issue on how to continue to scale LLM. Even scientific papers have a hard time answering those kind of questions because unless in very special circumstances where we can show with a good confidence that there are limitations (P vs NP for instance) the answer will simply be given by the most successful approach.
- krona 3y agoUsually its the most credentialed I'm least interested in listening to, especially when the value of those credentials are dependant upon the future looking a particular way.
- semiquaver 3y agoNot sure where I heard this but it’s apparently a common trope that many of the politicians and leaders that treat The Economist as close to holy writ are often horrified to learn that most the staff is actually a bunch of very precocious 20-somethings that are good at research and writing in an authoritative tone. Actually, now that I think of it, not so different from LLMs… (Full disclosure, I’ve been a subscriber for a couple of decades)
- koboll 3y agoAlso true about every single consulting firm
- jackmott42 3y agoI'm pretty excited by the possibilities. I am astounded by how much these language models can do with nothing but "predict the next word" as the core idea. I imagine in the near future having collections of a hundred different models, physics models, grammar models, fact models, sentiment models, vision models, wired all together by coordination models, and wired up to math tools and databases to ground truth when possible. I think it can get pretty wild. Just chatGPT wired up to Wolfram Alpha is already pretty creepy amazing.
- d--b 3y agoRoads?! Where we’re going, we don’t need roads
- xwdv 3y agoI remember how hyped people were seeing the progress from GPT3.5 to GPT4, people really felt like many jobs were going to be replaced very soon. The next big advancement was around the corner. I think the limitations of LLMs should be more salient to them by now.
- letitgo12345 3y agoIt's been literally just 3 months since GPT-4 was released. I think you're gonna see a lot of changes especially once GPT starts being trained on ChatGPT data
- flangola7 3y agoOpenAI can just filter out text that they generated. Other models might be problematic.
- letitgo12345 3y agoI'm talking about RLHF on their chatbot data, not ChatGPT data on the web.
- skepticATX 3y agoI think the worst case scenario, and the one that I think is the most likely, is that we plateau at broad and shallow AI. Broad enough such that it can be used to replace many workers (it may not do a great job though), but narrow enough such that we don't really see the kinds of productivity increases that would usher in the pseudo-utopia that many AI folks talk about.
- sheepscreek 3y agoSam Altman has been saying this for months. Nothing noteworthy here for someone following the industry closely. A16z’s latest summary of the landscape was way more useful and relevant than this.
- ChatGTP 3y agoSam had been saying it but few people trust he is telling the truth imo. Maybe he was.
- famouswaffles 3y agoSam is telling the truth I'm sure but he's commenting on economic walls rather than necessarily capability ones.
- attemptone 3y agoFollowing research instead of the industry would this make a basic fact known for a while.
- dpeckett 3y agoSparse networks are the future, there's definitely a few major algorithmic hurdles we'll have to cross before they end up a real option but long term they will dominate (after all they already do in the living world). All our current approaches rely on dense matrix multiplications. These approaches necessitate a tremendous amount of communication bandwidth (and low latency collectives). This is extremely challenging and expensive to scale O(n^2.3). The constraints of physics and finance make significantly larger models out of reach for now.
- michaelteter 3y agoIsn't the fundamental problem that LLM's don't actually understand anything (as greater concepts), but rather operate as complex probability machines? My 2 month active experience with ChatGPT-4 gave me the following takeaways: - when it's right, it's amazing; and when you, the operator, can recognize the niche use case where it performs really well, it can be a game-changer (although you could have programmed a tool to do the same narrow task) - when it's a little wrong, you (the expert) can fix the issue and move on without friction - when it's any amount of wrong and you are less than an expert, or specifically you are completely unfamiliar with the topic, you can waste an immense amount of time researching the output and/or iterating with the system to refine the result Initially I thought it was a 10:1 ratio of performance to effort. But finally (as a developer) I settled on (1 to 1.5):1. It basically just changed the game for me from doing the actual hard work to working out how to tease the system into producing a reasonable result. And in the process (same as with co-pilot) I started to recognize how it was leading me to change my habits to avoid thinking and effort and instead rely on an external brain. If you could have a reliable external brain always available, that would be a fair trade. But when the external "brain" is unreliable and only available via certain interfaces, it's better to train yourself to be proactive, voracious (with respect to documentation), and tolerant of learning/producing cycles. I once thought it would be a game-changer. Now I realize it is a game-changer, but in a similar way that offshoring was... it didn't improve or solve any problems, but it merely changed the work.
- letitgo12345 3y agoThe next iteration will be trained on your own data where "when it's a little wrong, you (the expert) can fix the issue and move on without friction" so that case will become "when it's right" and some amount of "when it's any amount of wrong" cases will become "when it's a little wrong". A few more cycles of this and we could be looking at GPT-10 which is a complete replacement for most tasks.
- ChatGTP 3y agoHmm, wouldn’t this only be useful if you were solving the same problems over and over again, which does happen but say in the case of programming, I’d put the reusable pieces into a library, not a language model? Like you’d train the model to give you the most accurate response based on your current problem space, but when they changes, you’d have to retrain on what you’re working on but by that stage it’s already out of date ?
- letitgo12345 3y agoThe optimal way right now seems to be to train a gigantic model to get strong capabilities and use distillation to make a much smaller model stronger. But you seem to still need that gigantic model and we still don't know if we're running out of space to improve capability just by scaling up the model (for reference GPT-4 is likely 1.76T parameters and we may be able to get much better just by scaling up)
- varelse 3y ago[dead]
- ftxbro 3y agoI've been following the LLMs and I don't think it's 'running out of road', except in the sense that it's expensive. The model perplexity keeps decreasing when you scale up the parameters and exaflops and dataset sizes in the right proportions, and this decreasing perplexity is what has been unlocking so many amazing cognitive capabilities. I think the limitations are about regulatory deals not about any kind of technical roadblocks.
- jeswin 3y agoA big part of understanding concepts (and being able to reason) is correlating with patterns you already know. Even though there are errors, LLMs are doing fairly well at pattern recall. Which makes me believe that we're perhaps one additive breakthrough away from another major leap in abilities.
- _cs2017_ 3y ago"Many in the AI field": who exactly? Shouldn't the author quote a few famous people when making this claim?
- willmadden 3y agoDefine “running out of road”. Road to control narratives or road to be useful?
- esafak 3y agoThere are no datasets that are an order of magnitude bigger, and the latest model itself may be a mixture of experts; i.e., more of the same.
- dwaltrip 3y agoThe last paragraph in the article: > That such big performance increases can be extracted from relatively simple changes like rounding numbers or switching programming languages might seem surprising. But it reflects the breakneck speed with which llms have been developed. For many years they were research projects, and simply getting them to work well was more important than making them elegant. Only recently have they graduated to commercial, mass-market products. Most experts think there remains plenty of room for improvement. As Chris Manning, a computer scientist at Stanford University, put it: “There’s absolutely no reason to believe…that this is the ultimate neural architecture, and we will never find anything better.”
- ruleryak 3y agoIt's an incredibly important point - We have so many a-ha moments ahead of us in this field. Seemingly minor changes yielding task speed multipliers, fresh eyes on foundational codebases saying now why the heck did they do it that way when xyz exists and works better, etc. A recent graphics driver update took my local SD performance from almost 4 seconds per iteration to 2.7it/s because someone somewhere had an a-ha moment. We're practically in the Commodore 64 era of this technology and there are only going to be more and more people putting their eyes and minds on these problems every day.
- lee101 3y ago[dead]
- jiggawatts 3y agoThere was a recent post here linking to the blog “The Secret Sauce behind 100K context window in LLMs: all tricks in one place” : https://blog.gopenai.com/how-to-speed-up-llms-and-use-100k-context-window-all-tricks-in-one-place-ffd40577b4c https://blog.gopenai.com/how-to-speed-up-llms-and-use-100k-c... My impression is that combining all of those, plus all of the post training quantisation and sparsity tricks into a new model with more training compute than GPT would yield an amazing improvement. Especially the price/performance would be expected to dramatically improve. The current models are very wasteful during inference, there’s easily a factor of ten improvement available there.
- vouaobrasil 3y agoAI should not get better. We are playing with fire because the technology is moving too fast. We should consider the ethical implications of it before developing it, not after.
- goldenshale 3y agoAs if anyone is good at predicting the future. Please can we stop acting like expertise equates to fortune telling capabilities?! Nobody has any clue what a 1000x sized GPT model could do, and anybody who makes strong claims is a charlatan. In this age of paranoid AI risk cultists we need to cultivate humility and calm, a willingness to follow data rather than beliefs and predictions.
- JimtheCoder 3y agoSir, this is a discussion forum...
- ignoramous 3y ago> As if anyone is good at predicting the future. Whoever predicts the right direction, (and when the time is right) puts money where their mouth is, stands a shot at unseating... the alt man. I think the way to use these big ideas is not to try to identify a precise point in the future and then ask yourself how to get from here to there, like the popular image of a visionary. You'll be better off if you operate like Columbus and just head in a general westerly direction. Don't try to construct the future like a building, because your current blueprint is almost certainly mistaken. Start with something you know works, and when you expand, expand westward. The popular image of the visionary is someone with a clear view of the future, but empirically it may be better to have a blurry one. paulgraham.com/ambitious.html
- ilaksh 3y agoWarning people about potential extreme risks from advanced AI does not make you a cultist. It makes you a realist. I love GPT and my whole life and plans are based on AI tools like it. But that doesn't mean that if you make it say 50% smarter and 50 times faster that it can't cause problems for people. Because all it takes is systems with superior reasoning capability to be given an overly broad goal. In less than five years, these models may be thinking dozens of times faster than any human. Human input or activities will appear to be mostly frozen to them. The only way to keep up will be deploying your own models. So to effectively lose control you don't need the models to "wake up" and become living simulations of people or anything. You just need them to get somewhat smarter and much faster. We have to expect them to get much, much faster. The models, software, and hardware for this specific application all have room for improvement. And there will be new paradigms/approaches that are even more efficient for this application. For hyperspeed AI to not come about would be a total break from computing history.
- SanderNL 3y agoGPT4 is better than its predecessor and quite impressively so. The (probable) param count reflects that. It’s not just param count, because not all large models are good, but it clearly is part of the equation. I always wondered why Altman said going bigger is a dead end. If it were true, saying it would needlessly inform your competition. What’s the use in that? If it were false it might dissuade them from going down that path.. I think I got my answer.
- PeterStuer 3y agoTo be fair, many in the AI field never thought this approach would have worked at all, and were caught with their pants down when results started coming out.
- digitcatphd 3y agoMark Zuckerberg made a good point in his Lex Friedman podcast referring to LLAMA, that he foresees not one master model but a bunch of speciality purpose smaller models built on base models with fewer parameters
- NalNezumi 3y agoIf the title is correct, a welcoming trend for someone like me trying to apply the advancement in robotics/embodied agent. The bigger the model (generally) the more data required is a constraint very hard to satisfy on a hardware with other requirements (energy consumption, inference speed, memory limitations), not to mention the data collection that is order of magnitude more tedious compares to image and texts
- elif 3y agoAfter a year of Tesla FSD beta I agree 100%. I used to think that adding more and more and more real world video events to the training pool was contributing at least a diminishing value to the model. But the worst of all behaviors have not diminished and some have actually gotten worse. Most of the improvements now come through what feels like manual heuristics and tuning parameters rather than any actual improvement in intelligence. I sincerely hope there is a path forward that involves meaningfully culling data which is producing bad behavior, stronger guardrails, and/or a new paradigm in how the model is built from the data entirely, as I don't see a path to level 3 by simply growing the existing model.
- krisoft 3y ago> Most of the improvements now come through what feels like manual heuristics and tuning parameters rather than any actual improvement in intelligence. So if I understand your are driving a Tesla car with Full Self-Driving (FSD) capability, but you are not an engineer at Tesla who is privy to implementation details. How do you know if a change you perceive is caused by model retraining vs manual heuristics and tuning parameters?
- elif 3y agoYou missed the part of where you quoted me where I said "feels like" and invented a part where I said "have empirical evidence" Though to answer a softer form of your question which is based in my feelings, I would say through a combination of my experience writing AI's, coursework in my AI specialized computer science degree, and through reading the patch notes which often state explicitly the tunings I mentioned.
- tkgally 3y agoNaive question, perhaps: What roles are multimodal models likely to play in the future of AI? The comments here and in the Economist article seem to be about only large language models. In the initial announcement of GPT-4 in March, OpenAI described it as “a large multimodal model (accepting image and text inputs, emitting text outputs),” but they haven’t yet released the image part to the public. What will happen when models are trained not only on text, and not only on text and images, but also on video, audio, chemical analyses of air and other substances in our surroundings, tactile data from devices that explore the physical world, etc.?
- sidewndr46 3y agoIs this really a bad thing, or a problem at all? Some researchers found that increased scale resulted in increased utility. LLMs aren't generalized AI, but they seem to be good at some stuff. Their must intrinsically be some limits to this approach. But that doesn't mean it is a problem or that LLMs cant serve some useful role. Just consider for a moment if we could train an LLM on the combined experiences of all humans that have ever lived. No one is going to suggest that we must go bigger.