26 ms·
What a weird future it would be if Carmack turns out to be the one to figure out the critical path and get it all working. An entire field of brilliant research
by echelon 7y ago
What a weird future it would be if Carmack turns out to be the one to figure out the critical path and get it all working. An entire field of brilliant researchers be damned.
History books (for as long as those continue to exist) would cite AGI as his major contribution to society, and his name would be more renowned than Edison or Tesla. An Einstein. None of his other contributions will matter, as the machines will replace it all.
Just daydreaming, though.
- derefr 7y agoI wonder how many historical figures went through the same thing? Who do we know for their contributions to field X, when 99% of their life was spent contributing to field Y?
- jorblumesea 7y agoVery few, at least for STEM fields. If you look at notable scientists in any given field, their main contributions were in their expertise area before the thing that made them famous. Teller had already made serious contributions to physics before the atom bomb. Jennifer Doudna (CRISPR, CAS9) was the first to see the structure of RNA (except for tRNA) using an innovative crystalline technique. Planck is mainly known for quantum physics, but made huge contributions to the field in general. It's hard to think of many famous scientists that weren't already well known in their field. Some stand out. Einstein, for example, had a fairly lackluster career until his Annus Mirabilis papers. Mark Z. Danielewski (House of Leaves) bounced to and from various jobs. But largely, the idea of the brilliant outsider is like the 10x engineer. It exists, but is rare.
- zwaps 7y agoEven Einstein I would not say didn't have formal training. He had been in and around academia for most of his life. He was obviously far ahead of the curve, but he did accumulate the formal training. His stint in a regular job was more of an anomaly than his affinity to academia and physics.
- jorblumesea 7y agoRight, even Einstein had some serious academic training and mathematical chops. But I would argue that he was a bit of a wild card, because he was unable to secure a teaching positions and looked very mediocre from an academic perspective. But fair point, even the geniuses had formal training and instruction.
- hestefisk 7y agoI like that you put Danielewski in (almost) same sentence as Einstein. HoL is a stroke of genius!
- DavidSJ 7y agoIsaac Newton spent most of his life pursuing alchemy and obscure theological ideas, and found it a real nuisance whenever anyone pestered him about math or physics.
- jeromebaek 7y agosource?
- DavidSJ 7y ago_Never At Rest_ by Richard Westfall is the authoritative biography on him.
- DEADBEEFC0FFEE 7y agoThat's a great example. He also spent a long time at The Mint.
- lonelappde 7y agoNot true. https://en.m.wikipedia.org/wiki/Isaac_Newton https://en.m.wikipedia.org/wiki/Isaac_Newton
- DavidSJ 7y agoCan you expand on why you think his Wikipedia article refutes what I said?
- mkl 7y ago(Not OP) I don't think it does. It backs you up (barring quibbles on what you mean by "most"; years active or hours spent): "Beyond his work on the mathematical sciences, Newton dedicated much of his time to the study of alchemy and biblical chronology".
- armitron 7y agoVery true. Newton was an alchemist first and foremost and spent the vast majority of his time practicing alchemy rather than -what today one would call- science. One has to wonder what private reasons/results a genius of his magnitude had, in order to do that. This little known fact is so embarrassing to some institutions [2], that they made up a new word "chymistry" in order to further obscure the issue and not outright admit the obvious. [1] http://www.newtonproject.ox.ac.uk/texts/newtons-works/alchemical http://www.newtonproject.ox.ac.uk/texts/newtons-works/alchem... [2] https://webapp1.dlib.indiana.edu/newton/project/about.do https://webapp1.dlib.indiana.edu/newton/project/about.do [3] https://www.amazon.com/Newton-Alchemist-Science-Enigma-Natures/dp/0691174873/ref=sr_1_2?keywords=newton+alchemy&qid=1573708755&sr=8-2 https://www.amazon.com/Newton-Alchemist-Science-Enigma-Natur...
- briefcomment 7y agoNot an extreme example, but Albert Szent-Gyorgi is known for his work with Vitamin C, when his work on bioenergetics and cancer are more interesting and possibly more promising.
- pacala 7y agoNot being constrained by the publish or perish treadmill is a huge plus.
- mrfusion 7y agoI don’t think there are many researchers in AGI. AFAIK it’s kind of a joke field because no one has any clue how to approach true AGI. Please correct me if I’m wrong.
- Jach 7y agoPeople have approaches. There's no end to half-assed "I thought about this for 10 seconds, how hard could it be!" solutions, really old approaches from decades ago where the brightest academics thought they could lick the problem over a summer, and some new public or hidden approaches that might be promising but (I can't know of course) I predict will still look a lot different than the final thing. I think a big reason there are few in AGI is due to PR success from the Machine Intelligence Research Institute and friends. They make a good case that things are unlikely to end well for us humans if there's actually a serious attempt at AGI now that proves successful without having solved or mitigated the alignment problem first.
- MetalGuru 7y agoThe alignment problem?
- retsibsi 7y ago> The alignment problem? The problem of ensuring that the AI's values are aligned with ours. One big fear is that an AI will very effectively pursue the goals we give it, but unless we define those goals (and/or the method by which it modifies and creates its own goals) perfectly -- including all sorts of constraints that a human would take for granted, and others that are just really hard to define precisely -- we might get something very different from what we actually wanted.
- deleted 7y ago[deleted]
- TeamSlytherin 7y agoYes, AGI is as much or more cognitive neuroscience and philosophy than computer science right now, but a lot depends on the approach one is taking. It's funny to think you have some kind of working model you can throw research data against to see how it holds up, and then doubt yourself when you spend 3 hours on Twitter arguing over fundamentals with another person that is also convinced of their model. A lot of popular ideas sound crazy (or non-workable), so you just have to accept that whatever idea you are pushing is going to crazy as well.
- gdy 7y ago"his name would be more renowned" Or hated as the name of the man who's opened the Pandora box and doomed us all. Just daydreaming and having a nightmare.
- james_s_tayler 7y agoI'm Too Young To Die.
- ddingus 7y agoThe way I see it, people like this when they have the time and inclination, should make an attempt. You never know. Fresh eyes can sometimes see what others may not.
- goatlover 7y agoI'm not sure I want AGI to succeed, given some of the possibilities. Sure if it plays nicely alongside us, amplifying human society, that's great. But if we get relegated to second class with the AIs doing everything meaningful, then no thanks. But it's still a fascinating endeavor.
- CriticalCathed 7y agoWhy not? I'd say that a world that is managed by AGI with limited input from human beings is a good goal to have. If AGI could be done without the nasty parts of human psychology and they're inherently superior to genetically intact human beings why shouldn't be embrace it? I understand that it's a big assumption to make -- that a benevolent AI could be constructed. But under that assumption, why not have a benevolent dictator in the form of an AI?
- goatlover 7y agoMaybe. Yeah, human politics and justice systems leave something to be desired. But my worry was little bit beyond that. That the AIs would take all the meaningful work, discoveries and creativity away from us, leaving us just to amuse ourselves. Some people might be okay with that, but I don't think becoming pets is the best goal for the human race. If the benevolent AI ruler(s) restrained themselves to allow for humans to flourish, then okay. Assuming it could be constructed benevolently.
- saiya-jin 7y agoThere is another threat when things go wrong (and they eventually always do) - no matter how horrible some dictator is, eventually he/she will die, and at some point things get reshuffled by war/revolution/some other more peaceful means. With AI, it would try its best to preserve/enhance/spread itself forever. And its best might be much better than our best...
- vkou 7y ago> Why not? I'd say that a world that is managed by AGI with limited input from human beings is a good goal to have. We already live in that world, with large institutional bureaucracies playing the role of paperclip-maximizing AGIs. It's pretty wretched when you are in their path.
- james_s_tayler 7y agoDoom. Just think about that name for a second. He might really be onto something.
- ageofwant 7y agoI am thinking the guy that made Doom is the guy that's making SkyNet and I'm totally cool with that.
- guramarx11 7y agoiirc in a recent talk with Joe Rogan, John mentioned something about robots doing judo...
- copperx 7y agoWhy do people of such intelligence subject themselves to being interviewed by dumb-as-a-rock Joe Rogan? I must admit that I often watch his interviews because he invites interesting people, but I can't help but cringe when Rogan gives his opinions.
- MetalGuru 7y agoSeriously. That guy is a stoned idiot who massively overestimates the insight of his high ramblings.
- saagarjha 7y agoI don't think people listen to the show to listen to him, and he probably knows that. He does, however, seem to be reasonably good at getting his guests to talk about interesting things.
- dkersten 7y agoHe also spreads misinformation. EDIT: Ok, I suppose I should back my claim up. Joe Rogan has pushed the “DMT is produced in our pineal gland” narrative, but there is no evidence to back this up. I’ll report a comment I made elsewhere and also link a separate reddit discussion which cites various sources. I will note that, in fairness to Joe, he said this a while ago, so perhaps he’s not so quick to jump the gun now, I don’t know, I don’t listen to his podcasts, but perhaps he’s better now. “We all have it in our bodies” — This is an often repeated myth that has never been proven. The myth originates from Rick Strassman’s work, who himself has said that he only detected a precursor, not DMT itself and that everything else he wrote about it was hypothetical speculation. There have, apparently, been recent studies that found DMT synthesised in rat brains, but it has not yet been proven whether this translates to humans or not. Cognitive neuroscientist Dr. Indre Viskontas stated that while DMT shares a similar molecular structure to seritonin and melatonin, there is no evidence that it is made inside the brain. Similarly, Dr. Bryan Yamamoto of the neurosciencedepartment at the University of Toledo said: “I know of no evidence that DMT is produced anywhere in the body. It’s chemical structure us similar to serotonin and melatonin, but their endogenous actions are very different from DMT.” This reddit discussion also links various sources, although I didn’t check them all myself: https://www.reddit.com/r/JoeRogan/comments/mwz2h/dmt_has_never_been_found_in_the_pineal_gland_and/ https://www.reddit.com/r/JoeRogan/comments/mwz2h/dmt_has_nev...
- dingo_bat 7y ago> None of his other contributions will matter I don't think anything can top Doom.