6 ms·
That exact line illustrates that he does not understand Meyers' objections. He thinks Meyers meant that we need to also model all of the information that the br
by scott_s 16y ago
That exact line illustrates that he does not understand Meyers' objections. He thinks Meyers meant that we need to also model all of the information that the brain gains as it interacts with its environment. That is not what Meyers meant.
What he meant is that we need to model everything that happens to the brain before it becomes a brain. That is, how the proteins interact with each other in the physical world to form the brain. Meyers' analogy was that the genome is the data, and the physical laws of the universe are the program. People are modeling how proteins fold and interact in the physical world, but it's a hard problem, and we're far from being able to do it for an entire organ.
- ugh 16y agoJust for context, PZ Myers is a evolutionary developmental (“evo-devo”) biology researcher, which explains the thrust of his criticism. That kind of stuff (developmental processes in embryos, i.e. how the darn animal is built) is right up his alley.
- jasongullickson 16y agoBased on this post (and more so what I've been able to find of the original discussion) I don't think he's overlooking this at all; if anything it's so obvious that he's not calling it out literally, like saying "I'm building an automobile"; you don't expect to have to say it's going to have wheels...
- scott_s 16y agoThat's because we already know how a car works. We know that wheels and an engine are necessary, but a cupholder is not. Meyers' point, as I understand it, is our understanding of the brain is not yet sophisticated to know what we can exclude from simulation.
- kragen 16y agoWhen Wilbur and Orville Wright went to go build a bird, they did not endow it with a beak and talons.
- nkassis 16y agoIs that even required? I mean, to simulate a brain, would you really need to go all the way down to simulating every cell or could an averaging of the interactions be enough? I don't know if what I said even makes sense but I really don't believe that we need something that simulates the brain at the cell level to replicate some of the processes.
- scott_s 16y agoWe don't know, which I think is Meyers' point. That is, until we understand all of these interactions, we don't know what the brain actually is.
- ynniv 16y agoLets separate "modeling the brain" into two classes of work: modeling the interaction of complex proteins in large systems, and modeling the physiochemical structure of the brain. The first is very difficult, and we have been working on it for a some time already. Meyers' argument is that this is an astoundingly intensive job that will take an prohibitive amount of time. The later relies on both the former, and an understanding of how the most complex biological structure that we are aware of is constructed. Kurzweil suggests a (surprisingly low) bound on the complexity of this structure (which builds on complex proteins and should be seen as multiplicative of the former complexity). But to say that Kurzweil is an optimist is to completely miss his perpetual argument. As drug companies dump billions USD annually into both complex protein research and sequencing technologies, we advance the state of the art in both of these classes. And while we have a long way to go, automation will get us there faster every year. If Meyers were to show that Kurzweil's estimation of complexity was off by 1000-fold, Kurzweil would still win because we would reach the goal 12 years later than expected, and "off by 12 years" isn't as wrong as "never".
- sprout 16y ago>Kurzweil suggests a (surprisingly low) bound on the complexity of this structure (which builds on complex proteins and should be seen as multiplicative of the former complexity). I think this is where most everyone really is missing the power of exponential growth, to use Kurzweil's language. The difference between "surprisingly low" and spot-on is +-5 years in Moore's law time. Really what it boils down to is how long Moore's law continues.
- ynniv 16y agoA (the?) key point of Kurzweil's work is to show that the exponential growth of technological leverage is independent of Moore's law. His prediction is that when Moore's law runs out (being tied to transistor density, it must), something else of the same shape will replace it. That is obviously yet to be proven, but there are some nice historical graphs at http://en.wikipedia.org/wiki/Accelerating_change http://en.wikipedia.org/wiki/Accelerating_change.
- joecode 16y agowe need to model everything that happens to the brain before it becomes a brain Perhaps the disconnect here is that Kurzweil, operating from an information theory perspective, is neglecting the possibility that the biological environment in which a brain grows effectively adds a ton of "data" to the system. That is, it's not as if brains can spring fully formed from the genome itself, and a few basic rules--it requires a very complex environment. So we're probably talking far, far more than 50MB of "data" here.
- ewjordan 16y agoPerhaps the disconnect here is that Kurzweil, operating from an information theory perspective, is neglecting the possibility that the biological environment in which a brain grows effectively adds a ton of "data" to the system Please realize, despite the fact that pretty much everyone on HN is repeating this argument (the "data gets added to the system" argument), it is an extraordinary claim, and should require correspondingly extraordinary evidence if we're to consider it. I'm going to justify this in excruciating detail, because the claim has now come up so many times. But first, let's nail down the context, because if we can't agree on that then we really shouldn't even be discussing the topic (and I suspect the whole problem here is that Myers thinks they're arguing about something other than what Kurzweil is actually claiming) - we're discussing the amount of information that we would need to construct an effective intelligent algorithm. Not one particular algorithm, but any effective intelligent algorithm. Here goes, a pseudo-mathematical breakdown of why this "data gets added" argument is so hideously wrong: There's an entire infinite universe of "possible intelligence algorithms" (for the moment, we won't define this too precisely, but we'll hand wave and say that this universe consists of all algorithms that take the right inputs and provide the right outputs, whatever those are), most of which are utterly useless, and are certainly not intelligent. Let's call this universe U0. Step one: let's cut U0 down to a finite practical size, eliminating ridiculous algorithms that we could never expect to implement. We can do this in a million ways, it doesn't really matter; for now, let's just say that we're cutting it down to algorithms that have possible physical realizations using the resources on our planet. That's still a huge number of algorithms. Call this U1. Step two: Let's now trim U0 in a different way, picking out only the algorithms that we consider actually intelligent, however you want to define "intelligent". Name this (still infinite) set Z. Step three: Take the intersection of Z (intelligent algorithms) with U1 (practical algorithms), call this set P. P is all the practical algorithms that qualify as "intelligent". Now let Prob(I) = (size of P / size of U1), the probability that a randomly selected practical algorithm will be intelligent. This is an extremely small probability, but it's finite and non-zero (human intelligence suffices to prove that it's non-zero). Step four: Now we slice up U1 in a different way, and create a set D_N: the set of all algorithms that can be specified by growing a human from a string of DNA of length N (and that ultimately run within the space constraints). Step five: Set P(D_N) = intersection of D_N and P, all intelligent algorithms satisfying the space constraints that can be grown from a DNA string of length N. Ok, that's a lot of sets, but it's okay, we don't need most of them. One last calculation: Prob(D_N) = (size of P(D_N) / size of D_N), the probability that a randomly selected practical DNA-created algorithm will be intelligent. No more set-fu, I promise. We've boiled it down to two probabilities, Prob(I), and Prob(D_N). These probabilities are proxies for the information content needed to pick an intelligent algorithm out of the corresponding sets of algorithms. The "information gets added" claim has a very simple mathematical expression: Prob(D_N) > Prob(I) when N = the length of human DNA i.e. a randomly selected DNA-created algorithm with DNA length N has a greater probability of qualifying as intelligent than a randomly selected algorithm in general. And not just a little bit greater - you're saying that the fact that it's implemented via DNA makes the probability much higher, corresponding to the data difference you're claiming with the statement 'far, far more than 50MB of "data" here'. Perhaps now you see the trouble: in order for me to consider the "data gets added" argument plausible, I need to hear an argument that suggests that a random construction based on DNA is far more likely to lead to an intelligent algorithm than a random construction in general. Myers has not offered an argument in this direction. Neither has anyone else. Until someone does, the odds are overwhelmingly in Kurzweil's favor; statistically speaking, Myers is flat out wrong. So I put the question to everyone: what's so special about the DNA construction process that makes it so much more likely to create intelligence than any other construction process we might conceive of?
- dean 16y agoA lot of this discussion seems to be confusing reverse engineering with cloning. To reverse engineer something, you look at it as a black box and determine all of the capabilities and characteristics that you are interested in, and then you implement them in your own way. You do not need to understand how every last cell of the brain was created in order to build a machine that works like the brain. To reverse engineer the flight of a bird, you don't clone the bird, you build an airplane.
- ewjordan 16y agoThat is not what Meyers meant. [We meander midstream into a heated discussion between Kurzweil and PZ Myers...] Kurzweil: ...able to live...FOREVER! Kurzweil: ... Kurzweil: ...? Myers: FFS, Kurzweil, you dimwit, we're the only two people in the room, and you can't possibly think you're going to get your standing ovation from me... Kurzweil: Enhh...whoops, I guess my muscle memory kicked in, I've given that speech an awful lot of times, sorry about that...back to my main point, I guess: The Kolmogorov complexity of any "intelligence algorithm" is, with high probability, bounded from above by the size of the DNA string that picked that algorithm out of the entire universe of algorithms. Myers: Kurzweil, you fucking idiot, if we want to build a brain, we need a lot more than just the bits of information in the DNA. There's an entire developmental pathway leading from DNA to its ultimate expression in a human brain, and you can't just pretend that we could write a simple algorithm to collapse that into one step. Kurzweil: But I'm not saying that we want to build a brain by translating the DNA. I'm saying that the amount of information necessary to pick the brain's particular neural algorithm out of a full lineup of all possible neural algorithms (most of which would do nothing useful at all) must be coming from the DNA. Since the universe of all possible neural algorithms that can be expressed by DNA is highly unlikely to be have a disproportionate representation of useful neural algorithms, it's a matter of simple probability to see that the amount of information necessary to pick out a useful neural algorithm in any sufficiently large and random universe of neural algorithms is likely to be the same as the amount of information necessary to make that selection out of the DNA-expressible neural algorithms. Myers: But you can't just translate from DNA to a brain, GODDAMN it, this is basic biology we're talking about! There's a lot of stuff that happens between DNA and a brain, and you can't just ignore it! Kurzweil: Who said we were talking about biology? Myers: I'M A F$@KING BIOLOGIST, OF COURSE WE'RE TALKING ABOUT BIOLOGY!!!
- jacquesm 16y agoYou owe me a new keyboard.
- Retric 16y agoChemistry is a "solved problem" granted we don't have a computer that can run the simulation for large organic molecules, but it has ZERO secrets. Now, DNA runs on the cellular machinery, but that is also running on the well known chemistry rules so adding up the instructions required to define a cell + DNA = something of a lower bound on the required complexity to create a brain. The idea is if you know how complex a solution to the problem is, then you can use that complexity even if you are using a different approach to the problem. IMO, it does not say much. I can't comprehend the limits of 50MB of heavily macroed and slightly buggy LISP code. It's simply not a meaningful metric. Edit: Also, in theory we could write a program which would simulate human level intelligence, but run far too slowly to be useful in any meaningful context. PS: Findman had a wonderful description of chemistry as the search for rules of thumb to let people simplify the problem of simulating the physical equations.
- Jkeg 16y agoThe human brain does not need to store all the information in the environment in the genome to develop fully, so why should an AI need to? I expect an AI would include that data in the development of it's brain just as a human does, by being put in an environment to learn from and absorb that data. In other words, design and development are different kinds of data here, and a human's and an AI's initial brain design can be stored in ~50MB of data.