8 ms·
Something tells me that I haven't trained on 6 TB of code and can meaningfully outperform any AI. That tells me that there's something still structurally missin
by vlovich123 4y ago
Something tells me that I haven't trained on 6 TB of code and can meaningfully outperform any AI. That tells me that there's something still structurally missing about the training efficiency. I wonder if this replicates to things like chess/go - for a computer trained on the same number of games that a human is, is the computer still able to outperform a human?
- mysterydip 4y agoI wonder how curated the input data is. Just on the surface of it, there's a lot of spaghetti code out there that people may have shared. I once saw a codebase that used three different implementations of a date/time structure and overloaded operators to convert between them. Or people rolling their own crypto, sort, or random functions, reimplementing data structures, etc.
- RangerScience 4y agoIs this training just to understand code, or is training to understand code and language? (If we're comparing you to the model, is the model starting at "baby" or "teenager"?)
- famouswaffles 4y agoa baby is still predisposed to learning language (amongst many other things essential for human living/survival) thanks to the brain and evolution. No human is really starting from scratch in any meaningful way.
- mtlmtlmtlmtl 4y agoI think you're missing the forest for the trees here. First of all it's not well understood how infants are so able to learn languages, and the extent to which language ability is innate is fairly controversial in linguistics. Leaving the details aside, the fact that a human is not starting from scratch is not in dispute. But the whole point of the discussion it seems to me is the question of exactly how humans are not starting from scratch, i.e why do we learn so much faster, and how could we apply the answer to current techniques in machine learning? Those are still interesting questions whether or not humans and randomly wired neural nets are both starting from scratch.
- famouswaffles 4y ago>First of all it's not well understood how infants are so able to learn languages It's not well understood sure but the brain is evidently playing a crucial process. Children learn to speak languages at about the same time with the same milestones occurring at roughly the same ages. Not to mention the fact that despite wildly different cultures and situations (some cultures don't attempt correct their children ever, some cultures don't speak to babies), children learn language just fine. Controversy on exactly how much aside, we're obviously predisposed to it. >But the whole point of the discussion it seems to me is the question of exactly how humans are not starting from scratch, i.e why do we learn so much faster, and how could we apply the answer to current techniques in machine learning? The closest biological equivalent to a parameter in an ann is a synapse. Well humans have about 100 trillion synapses. We already know that the higher the parameter count, the lower the training data required. a 50 billion parameter model will far outperform a 5 billion one trained on the same data. and a 500b one would far outperform that 50 billion one. Economics limits how far we can go and i'm not making any declarative statements but who's to say that's not the issue ? ann and whatever the brain does diverged in details a long time ago. It's cool to speculate and all but any special insight on the brain would have little implications on the future of deep learning. That's just not what drives architectural advances. we could have expert level machines in a couple years but any approach trying to copy the brain is decades if not centuries away. That's how little we understand. and how little impact that actually has on the DL of today. Current LLMS are actually nowhere near the scale of the human brain, either in parameters/neurons or training data (all the text we've ever trained an LLM on would be dwarfed by all the data humans perceive). as well as not having the headstart the human brain has. It's kind of a bogus comparison when you think about. You could easily make the case that LLMs are far more effective.
- vlovich123 4y agoIs my understanding of your argument that the near 24/7 auditory/visualize constant input + the brain having way more neurons helps or converge faster? I can buy that. The challenge of course is someone like Hellen Keller who had very little input in terms of quantity and yet still managed to develop into an intelligent adult once we figured out how to communicate with someone like that. The weak spot of my argument is that it took me 20 years of on and off training, maybe 4-12 hours per day most days to get to this state. By comparison AI gets to maybe my experience level after a few years or so in months. So maybe it doesn’t actually take that much time comparatively (despite having a much lower ceiling). The part that I’m not quite sold on though is the comparison on number of neurons. We don’t actually have a good handle on how many neurons are equivalent and a non-trivial amount of a brain’s neural net is responsible for real time signals processing of high fidelity audio and video, propiecption, motor controls etc, running your body, filtering and converting inputs into long term storage + combining it all with higher order executive functions and thought that can override a good chunk of it. It doesn’t feel like the strongest argument to make to say all that complexity is needed to create human-level intelligence in terms of comparing neurons (there may be reasons those are things are needed, but creating an LLM with the same number of neurons probably won’t work). The compelling part for me is to continue the analogy of the brain which motivated this line of AI research. We know that the brain has all sorts of different structures and they map pretty closely to different functions and it’s not just one giant language center. Wouldn’t it make sense that we’d need different kinds of AI models to build a fully functional AI? Not least of which because specialization can be computationally more efficient (eg various computational imagery tasks are doing extraordinary things and they’re not just throwing large and larger LLMs at the problem)
- stephc_int13 4y agoIf you look at Chess, Poker or writing Python, I am not sure that natural evolution is giving us a huge head start. And still, human experts in those fields don’t need as much data, even with our slow brains, the convergence rate is astounding, compared to machine learning.
- mr_toad 4y agoI’d say that an understanding of causality helps people learn chess. Maths, from counting through algebra helps people learn to program. I’d imagine it would be hard to understand the concept of a loop if you couldn’t count.
- littlestymaar 4y ago> If you look at Chess, Poker or writing Python, I am not sure that natural evolution is giving us a huge head start. The point you're missing is that those games have been designed by humans, for humans, so even if the natural selection didn't give us any advantage in playing chess per se, it conditioned our brain in a way that made us invent chess in the first place. That being said, the original argument of comparing NN training data and natural selection is stupid anyway.
- stygiansonic 4y agoFor more background for those interested, this is known as Universal Grammar: https://en.wikipedia.org/wiki/Universal_grammar https://en.wikipedia.org/wiki/Universal_grammar
- saurik 4y agoAre you implying that a human--maybe you--might somehow have experienced 6 TB of English if you just go back to when they are a baby?
- famouswaffles 4y agoLook i'm not going to say the transformer is as efficient as the brain but you are not starting from Zero. any Code LLM will be learning language and code and everything else, with absolutely no predisposition to either. Your brain is baked with millions of years of evolution with specific areas already predisposed to certain types of processing before you ever utter a word.
- coldtea 4y ago>Look i'm not going to say the transformer is as efficient as the brain but you are not starting from Zero. Still, we can rewrite the parent's argument as: If we train an AI on the amount of non-code-related dataset (writing read/speech heard) I've consumed, and then add to it all the amount of code-related writing/speech (coding book, coding lessons taken, code and manual pages read, man pages, etc.) I've consumed, would it even remotely as good as coding as me? Or even as good as itself is now? I'd guess no. It's less effiecient, and thus needs way more coding dataset to get the point of coding than a human. Which brings us to: >Your brain is baked with millions of years of evolution with specific areas already predisposed to certain types of processing before you ever utter a word. Isn't that the whole point the parent is making? That our advantage isn't about dataset-volume, but architecture.
- famouswaffles 4y agoThe closest biological equivalent to a parameter in an ann is a synapse. Well humans have about 100 trillion synapses. We already know that the higher the parameter count, the lower the training data required. a 50 billion parameter model will far outperform a 5 billion one trained on the same data. and a 500b one would far outperform that 50 billion one. Current LLMs are actually nowhere near the scale of the human brain, either in parameters/neurons or training data (all the text we've ever trained an LLM on would be dwarfed by all the sense data humans perceive), as well as not having the headstart the human brain has. It's a bogus comparison when you really think about it. You could easily make the case that LLMs are far more efficient.
- 4y ago
- mtlmtlmtlmtl 4y agoResponding to your chess question. Starting with random weights? No, not even close. For a talented(i.e having some innate ability to learn the game) child, it's actually hard for me to describe how fast they can improve even over the course of a single game. I've seen it happen in real time several times. It's very hard for me to ignore the intuition that there's some higher level cognitive process going on that can pick out abstract concepts and use them to control and focus the lower level "training" that might look more similar to what we're doing in ML these days.
- toxik 4y agoHow do you know that isn’t emergent given enough embodied experience of the world? This is the big thing with LLMs for me, showing that yes, if you scale up, all sorts of emergent abilities pop up. And LLMs aren’t even embodied, it’s still a very primitive approach and we’re already seeing this level of competence. Truly makes me wonder if I’m not just a stochastic parrot underneath it all.
- burkaman 4y agoThe computer was trained to respond to a text prompt with code, without looking anything up or running the code. You would not outperform it at that task, but that has very little to do with your actual job, so you would outperform it at more realistic tasks. Board games are many orders of magnitude simpler than real life, so it should be a lot easier for a computer to outperform a human with equivalent experience.
- cyanydeez 4y agoYou are narrow minded. They're a wide swath that's shallow.
- pedrosorio 4y ago> I wonder if this replicates to things like chess/go - for a computer trained on the same number of games that a human is, is the computer still able to outperform a human? The first computers to beat (and completely surpass) the best human beings at chess were not trained on anything. Just efficient search techniques and human feedback through heuristics/opening books.
- stephc_int13 4y agored black and minmax algorithms were not really useful, and heuristics are a kind of laborious encoding of experts human knowledge into code, so they were still trained, in an hardcodes manner. But overall, yes, the current state of machine learning relies on huge brute force compared to animal learning. Experts Chess players need to play many games to acquire sufficient intuitive knowledge, but they converge orders of magnitude faster than current algorithms. This weakness might be relevant later, for very dynamic and adaptable systems.
- opportune 4y agoAnd yet you have been alive longer than deep learning has existed, with more capable hardware than anything yet implemented in silico. Much of that time spent alive has trained things like planning, pattern matching, theory of mind, etc which all transfer to a lot of other tasks you do IMO it’s a meaningless comparison
- tsunamifury 4y ago[flagged]
- abeppu 4y ago> That tells me that there's something still structurally missing about the training efficiency. Imagine Alice is abducted by aliens and given reams and reams of unfamiliar symbols and trained to predict which one came next given a long long prefix. Alice held in a cell alone with just symbol sequences for 15 years, and by the end of that period she's gotten pretty good at predicting which symbol comes next. Bob's experience is exactly the same. Neither has any way to understand what any of the symbols mean. Finally, Alice and Bob are let out of their cells for a break, and meet Krang. Krang explains that Alice has been doing a sometimes acceptable job of producing computer code for a kind of computer she's never been able to directly interact with! She might have gotten really good by the end of year 1 if anyone had explained that she was writing programs, or given her access to a REPL, or a debugger, or a manual. But she's been trained with exactly the same procedure as Bob, who has been pumping out advertising copy. Current code LLMs are only doing next token prediction, and critically they don't have access to a model of formal semantics for each language, an interpreter or debugger or compiler, etc. This is a shame, because program generation is arguably one of relatively few areas in which we could give our models a "complete" view of the domain. An appropriately structured model could generate the program, predict and observe the AST, predict and observe the IR graph, predict and observe generated bytecode, predict and observe program traces from execution, etc, etc. But it doesn't do any of that. It doesn't have an explicit model of what the program will do during execution. It doesn't have an ability to check that an invariant is maintained at each iteration of a loop. It doesn't get to check that what it wrote behaves as intended. Yesterday, one of the chat models which also can generate code gave me a Kotlin example which used a language feature that Kotlin doesn't actually have (basically scala-style pattern matching), and of course was totally unaware that the generated code was not even valid Kotlin because it never attempted to call any part of the toolchain.
- viraptor 4y agoYou get a lot more context though. The training set is just "here's lots of code and some comments and docs". You trained on your own experience with interface, your process expectations as a human in real world, on the whole chains of "we need to achieve this, so we're splitting it into those tasks", and many other related contexts. In RPG terms, the models put everything into intelligence and no points into wisdom.
- mr_toad 4y agoI suspect that the reason that people find declarative and functional programming more difficult is that they have to ‘unlearn’ a lot of procedural thinking that we get from real world experience.
- Groxx 4y agoGiven how much data years worth of high resolution, 3D video and audio takes up, arguably you've trained on several orders of magnitude more data.
- marsven_422 4y ago[dead]
- jjallen 4y agoYou can answer with 90% accuracy how to do every beginner to intermediate coding action in every programming language in a few seconds?
- fhd2 4y agoYou're going into the unique advantage computers have over humans: They scale, a human doesn't. If you take away the "in a few seconds" part, it's not difficult at all to beat.
- jjallen 4y agoThe OP didn't mention which dimensions of inteligence/ability they could beat a computer. Surely scale/breadth of knowledge is one that matters.
- deleted 4y ago[deleted]
- alfor 4y agoYes, still huge low hanging fruits in the training/architecture. - multimodal - feedforward - proximal zone of developpement (you don’t start reading with shakespeare)
- tveita 4y agoIf you read that much code you could code in your sleep. So far that seems to be a good intuition for models based on LLMs - how well can you code without most of your higher reasoning facilities, just glancing at the previous text and typing whatever your gut feeling tells you? The programs that beat humans at chess and go have added structure to be able to plan ahead; they use a Monte Carlo search to play out the moves that "intuitively" look better, with another "intuition" check to see how good the position looks in the end. Similarly, AlphaCode [1] generates a large set of potential solutions and uses additional logic to verify that the code compiles, runs, and passes tests. [1] https://www.deepmind.com/blog/competitive-programming-with-alphacode https://www.deepmind.com/blog/competitive-programming-with-a...
- TeMPOraL 4y agoExactly this. I too find this to be the best intuition for LLMs right now: they're not comparable to an entire combined human mind - they're comparable to subconscious, or inner voice (as in, the part of your subconscious that interfaces with your conscious using language - aka. "the voice in your head", if you have one). So, as you say, if we had as much training as those LLMs, we'd be similarly good at coding by gut feel, with barely a conscious thought - and that's across pretty much any domain and technology that existed today. Compare with generic LLMs: a typical adult will be quite adept at saying somewhat coherent things on autopilot when prompted (!), which is reasonable given nearly two decades of constant exposure to natural language as written and spoken - but that same adult will be nowhere as good at this as GPT-4, and definitely not across so many different domains.
- shanebellone 4y ago"Exactly this. I too find this to be the best intuition for LLMs right now: they're not comparable to an entire combined human mind - they're comparable to subconscious, or inner voice" Strongly disagree. LLM traps you inside an intellectual bell curve.
- TeMPOraL 4y agoWhat is your take then? And please don't say "stochastic parrot" or "hype train".
- Kiro 4y ago> and can meaningfully outperform any AI That's a bold claim. What makes you think so?
- fennecfoxy 4y agoWell yes, because transformers just predict the next word to use. Their advantage is the concept of attention in order to better predict the next word (by deciding how relevant much earlier words are to the overall conversation). The transformer architecture isn't capable of general/unstructured thought like we are, but I'd love for someone to build an ideation model that feeds into a transformer when it needs to get input/output from the outside world. Abstract concepts will give us stronger AI, not 6TB of text; that should be reserved exclusively for communication purposes. It's like when you're thinking of something, but you can't remember the word for it. Then you remember the word. Transformers only work with the latter, what we need is something that can operate on the "something" without having to know the word for it (which is only relevant when talking to a human anyway).