19 ms·
AlphaCode as a dog speaking mediocre English
- mbgerring 5y agoAs I understand it, all of the progress in AI has come from taking existing theory and throwing enormous amounts of hardware at it. Which is interesting, sure, but whether it represents “progress” in the field of “artificial intelligence” is a different question.
- Permit 5y agoHere's an interesting article on this topic that you might enjoy: http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- mannykannot 5y agoThe way Scott describes it, AlphaCode appears to be practicing Agile / TDD! All it needs to do now is write its own tests. Update: See my reply to dudeinjapan's response - I had not been completely clear here.
- dudeinjapan 5y agoIt does write its own tests, i.e. to the extent it checks the generated programs work on the data provided and discards the ones that don't. I imagine many of the coding challenges it's trained on come with a few tests as well.
- mannykannot 5y agoI meant actually coming up with examples consisting of specific problems and their correct solutions (and maybe some counterexamples.) Ironically, I had just replaced 'test cases' with 'tests', because I thought that the former might seem too generic, and arguably satisfiable merely by rephrasing the problem statement as a test case to be satisfied.
- GreenWatermelon 5y agoThat would imply the AI already solved the problem, as it needs the solution inorder to generate tests, e.g. An AI can't test addition without being able to add, and so on
- mannykannot 5y agoThe problem here is to write a program, not solve the problem that this program is intended to solve. Clearly people can write tests for programs without necessarily being able to write a program to meet the specification, and in some cases without being able to solve the problem that the program is required to solve (e.g. plausibly, a person could write a tests for a program for solving Sudoku puzzles without being able to do that themselves, and it is possible to test programs that will be employed to find currently-unknown prime numbers.) Having said that, your point is kind-of what I was getting at here, though in a way that was probably way too tongue-in-cheek for its own good: When we consider all the activities that go into writing a program, the parts that AlphaCode does not have to do are not trivial. Being given solved test cases is what allows it to succeed (sometimes) with an approach that involves producing a very large number of mostly-wrong candidates, and searching through them for the few that seem to work.
- maest 5y agoThe approach reminds me more of junior devs who have no interest in fully understanding the code/problem and they just make semi-random changes to the code until the compiler is happy/the test is green.
- evrydayhustling 5y agoI love this take. Most AI results provoke a torrent of articles listing pratfalls that prove it's not AGI. Of course it's not AGI! But it is as unexpected as a talking dog. Take a second to be amazed, at least amused. Then read how they did it and think about how to do better.
- asdfasgasdgasdg 5y agoIt's rarely productive to take internet criticism into account, but it feels like AI is an especially strong instance of this. It seems like a lot of folks just want to pooh pooh any possible outcome. I'm not sure why this is. Possibly because of animosity toward big tech, given big tech is driving a lot of the research and practical implementation in this area?
- mannykannot 5y agoI suspect it is more visceral: AGI would demolish human exceptionalism, and also of the human mind as being the last refuge of vitalism.
- stephc_int13 5y agoAI has been over-hyped, that's all. The machine learning techniques that were developed and enhanced during the last decade are not magical, like any other machines/software. But people have different and irrational expectations about AI.
- ianbutler 5y agoHas it been over hyped? Some ML created in the last 8 years is in most major products now. It has been transformative even if you don’t see it, is informing most things you use. We’re not close to AGI but I’ve never heard an actual researcher make that claim or the orgs they work for. They just consistently show for the tasks they pick they beat most baselines and in a lot of cases humans. The models just don’t generalize but with transformers we’re able to get them to perform above baselines for multiple problems and that’s the excitement. I’m not sure who has overhyped it for you but it’s delivering in line with my expectations ever since the first breakthrough in 2013/2014 that let neural nets actually work.
- optimalsolver 5y agoI still don't believe deep learning is going to take us to AGI. The susceptibility of these systems to completely failing on weird inputs shows that it's a kind of massive memorization going on here, rather than true understanding. Has anyone tried searching for new basic operations, below the level of neural networks? We've been using these methods for years, and I doubt the first major breakthrough in ML is the most optimal method possible. Consider the extreme case of searching over all mathematical operations to see if something really novel can be discovered. How feasible would this be?
- zarzavat 5y ago> The susceptibility of these systems to completely failing on weird inputs shows that it's a kind of massive memorization going on here, rather than true understanding. Isn’t that a truism? “Understanding” is equivalent to AGI. Nobody would argue that we have AGI yet, but the intelligence-sans-understanding is somewhat similar to animal intelligence, which was the precursor to human intelligence. What should scare us is that we know that animal to human was not a difficult step evolutionarily.
- stephc_int13 5y ago>What should scare us is that we know that animal to human was not a difficult step evolutionarily. Do we know that? If that is not difficult, why is it so rare?
- CTmystery 5y agoPerhaps most of us in this forum have only the most basic exposure to biology? I say this because with any serious exposure you can't help but be dumbfounded by the complexity and "creativity" of nature. Everything is amazing! The fact that the pieces fit together is just wild and scary and awesome. To think that gradient descent and backprop will give us general intelligence, one of the great mysteries of nature, is incredibly hubristic, IMO. It's statistical inference at scale, with some heuristics up/downstream. It's a cool and useful tool for sure!
- 5y ago
- ogogmad 5y agoI've come up with an algorithm (the same as the AI's) for solving that linear system using a CAS. Feels relevant because this breakthrough is heralding an era of much more powerful CASes. We're getting close to an era where the drudgery in maths can be automated way.
- turminal 5y agoIt would be interesting to know how much of this improvement in the last 25 since he was a student comes from Moore's law, other hardware improvements, various new technologies not related to AI, amount of money being thrown at the problem... and how much of it are advancements in our understanding of AI.
- qualudeheart 5y agoIt’s mostly Moores law and scaling. Language model progress will be the next Moores law until diminishing returns are reached.
- visarga 5y agoA recent paper shows that empowering a language model to search a text corpus (or the internet) for additional information could improve model efficiency by 25 times [1]. So you only need a small model because you can consult the text to get trivia. That's 25x in one go. Maybe we have the chance to run GPT-4 ourselves and not need 20 GPU cards and a 1mil $ computer. [1] https://deepmind.com/research/publications/2021/improving-language-models-by-retrieving-from-trillions-of-tokens https://deepmind.com/research/publications/2021/improving-la...
- Isinlor 5y agoRoughly half/half, skewed more towards improvements in algorithms. Measuring the Algorithmic Efficiency of Neural Networks: https://arxiv.org/abs/2005.04305 https://arxiv.org/abs/2005.04305 In this work, we argue that algorithmic progress has an aspect that is both straightforward to measure and interesting: reductions over time in the compute needed to reach past capabilities. We show that the number of floating-point operations required to train a classifier to AlexNet-level performance on ImageNet has decreased by a factor of 44x between 2012 and 2019. This corresponds to algorithmic efficiency doubling every 16 months over a period of 7 years. By contrast, Moore's Law would only have yielded an 11x cost improvement. We observe that hardware and algorithmic efficiency gains multiply and can be on a similar scale over meaningful horizons, which suggests that a good model of AI progress should integrate measures from both. Mastering Atari Games with Limited Data: https://arxiv.org/abs/2111.00210 https://arxiv.org/abs/2111.00210 Reinforcement learning has achieved great success in many applications. However, sample efficiency remains a key challenge, with prominent methods requiring millions (or even billions) of environment steps to train. (...) This is the first time an algorithm achieves super-human performance on Atari games with such little data. EfficientZero's performance is also close to DQN's performance at 200 million frames while we consume 500 times less data. EfficientZero's low sample complexity and high performance can bring RL closer to real-world applicability. 500x improvement over ~10 years since DQN that roughly 2x improvement in sample complexity every year. A Time Leap Challenge for SAT Solving: https://arxiv.org/abs/2008.02215 https://arxiv.org/abs/2008.02215 We compare the impact of hardware advancement and algorithm advancement for SAT solving over the last two decades. In particular, we compare 20-year-old SAT-solvers on new computer hardware with modern SAT-solvers on 20-year-old hardware. Our findings show that the progress on the algorithmic side has at least as much impact as the progress on the hardware side. AI research has also tiny budgets compared to the biggest scientific projects: GPT-3 - $0.01B LIGO - $1B LHC - $7.5B JWST - $10B ITER - $20B ISS - $150B
- trabant00 5y agoPeople think more of what we already have is going to go farther. 1 horse to the carriage gets you to the market. 2 horses to the next village. 4 to town and 6 cross states. Given enough horses we should reach the moon, right? With absolutely no evidence (as none can be had about the future) I believe that AI can be reached with computers and programming languages as different from the current ones as rockets are to horses.
- qualudeheart 5y agoYou can launch a fast enough horse off a ramp and it’ll accelerate to escape velocity.
- alex-2k1 5y agoScientists in 50s expected to get language translation in 10 years as soon as computers will get enough computation power. They were real scientists, not "data AI scientists" who has little mathematics culture and not aware of any brain studies and problems in this field. But yeah, all aboard is hype train, we have a dog who speak English! Not a state machine that just do similar to what it was programmed on using statistics tricks. This is SO COOL!! PROGRAMMERS ARE DEAD!!!111 WOOOHOO SCIEEENCEEE!!
- gspr 5y agoWhile I echo some of these sentiments, I don't think they apply in the slightest to the author of the blog post this thread discusses. Certainly a "real scientist" in every sense.
- qualudeheart 5y agoAaronson doesn’t seem to believe in the scaling hypothesis like much of openAI and the Machine Intelligence Research Institute do. That’s the only hypothesis that predicts something like AGI from emerging from even bigger language models. Aaronson clearly isn’t expecting this tech to lead to AGI but that doesn’t make it not important.
- omnicognate 5y agoAs someone who is skeptical, but open minded, about the impact these technologies will have on practical programming I think I'm one of the "people" in "people are complaining..." The article makes some assumptions about what such people think that certainly aren't true for me: 1. That we are unimpressed. I'm gobsmacked. 2. That we don't think these are significant advances. They're obviously huge advances. 3. That we don't think these models will have practical applications. It's hard to imagine they won't. 4. That we think these systems are rubbish because they get things wrong. I'm a programmer. I make mistakes all the time. Having countered those views, the article then seems to imply that it follows that "we’ve now entered a world where 'programming' will look different." As someone who makes a living writing software I obviously have an interest in knowing whether that's true. I don't see much evidence of it yet. These systems are certainly not (yet) capable of replacing a human programmer altogether, and whether they could ever do so is unknown. I'm interested in the implications of the technologies that have been developed so far - i.e. with the claim that "we've now entered a world..." So the question is about how useful these systems can be for human programmers, as tools. The reason I'm skeptical of it is that the only model I've seen so far for such tooling is "have the machine generate code and have the human review it, select from candidate solutions and fix bugs". The problem is that doing so is, I expect, harder for the human than writing the code in the first place. I've mentioned this concern several times and not seen anybody even attempt to explain to me why I'm wrong about it. For example, at [1] I pointed out why some generated solutions for a particular problem would have only made my job harder and got accused of "screaming at a child for imperfect grammar." Reviewing and fixing code is harder than writing it. Please explain why I'm wrong about that (it's certainly true for me, but maybe most people don't feel that way?), why it won't be a problem in practice or what planned applications there are for these technologies that would avoid the problem. Please don't accuse me of cruelty to dogs or children. [1] https://news.ycombinator.com/item?id=30180067 https://news.ycombinator.com/item?id=30180067
- ogogmad 5y agoI think using these tools might become a science or an art form in its own right. You'll have to give these tools the input they need to produce the most useful answers to you. In the short term at least, this is not going to take away your need to think. But it might change how you think, and it might make you more productive when your problem aligns well with these tools.
- drooby 5y agoI think I agree with this take. We barely even know how our own brains learn and solve problems. We don't know exactly what the inner workings of AGI will look like... maybe this kind of problem solving is the emergence of that, perhaps in a different way to our own, perhaps not.
- qualudeheart 5y agoWhich rate of progress are we ITT expecting from alphacode-like models? In another thread I predicted we’d see competitive programming “solved” in ten years or less. I didn’t rigorously explain what I meant by that in that thread, so I’ll clarify what I meant. I expect AI to beat humans at competitive programming at the same rate as AlphaGo beats human Go players. There could be diminshing returns soon but I don’t see what would cause them.
- Misdicorl 5y agoThe places AI excel still have very rigid rules with relatively low branching factors. It's also relatively easy to score both the final result and any intermediate stage. And all the training techniques rely on those factors tremendously. My guess is that's where the difficulties will arise.
- belter 5y agoI am willing take on your bet, as long you agree with my condition...you can't feed it with any of the millions of lines of code previously created by humans you aim to beat...;-)
- machiaweliczny 5y agoI think we need AI to learn to simplify problems because no human (at least not me) solves these problems as stated but works on limited inputs and mostly via brute-force. Then you see some generalisation and you have your solution. Are they already doing that? If not expect 2x improvement easily. Also it would be great if algos were aware where in embedding space their solution is and then try to jump between "approaches".
- machiaweliczny 5y agoOk, I've skimmed the paper and they are doing clustering grouping by tests results. Ok that's first step. Now please instead do grouping by classification of algorithm by other NN first.
- 5y ago
- mark_l_watson 5y agoRight on, I couldn’t agree more. We are living during a period of exponential progress. I like AlphaCode’s approach of using language models with search. In the last year I have experimented with mixing language models for NLP with semantic web/linked data tasks, so much simpler than what AlphaCode does, but I have been having fun. I have added examples for this in new additions to two of my books, but if you want a 90 second play-time, here is a simple colab notebook https://colab.research.google.com/drive/1FX-0eizj2vayXsqfSB2ONuJYG8BaYpGO?usp=sharing https://colab.research.google.com/drive/1FX-0eizj2vayXsqfSB2... We live in exciting times. Given exponential rates of progress, I can’t really even imagine what breakthroughs we will see in the next year, let alone the next five years. EDIT: I forgot to mention: having GitHub/OpenAI tools like CoPilot always running in the background in PyCharm and VSCode has in a few short months changed my workflow, for the better.
- skybrian 5y agoCould you say a bit more about how you use CoPilot? What are the "other tools" you use?
- mark_l_watson 5y agoI installed the VSCode and PyCharm CoPilot plugins, and signed in with my GitHub account (you first need to request CoPilot access and wait until you get it). As you type in comments or code, CoPilot will sometime autocomplete up to about 10 lines of code, based on the content of the file you are editing (maybe just the code close to the edit point?). My other tools? I use LispWorks Professional, Emacs with Haskell support, and sometimes IntelliJ. I work a lot on remote servers so I depend on SSH/Mosh and tmux also.
- skybrian 5y agoDo you usually find the autocomplete from CoPilot useful enough to keep without editing, or is it wrong often enough to be annoying?
- 5y ago
- EGreg 5y agoNo, just no! Because the whole thing is, a dog’s abstract mental capabilities are far below a human — thus why it would be ASTOUNDING that a dog could master even a primitive form of speaking English. On the other hand, here we are brute forcing a solution from analyzing millions of man-years of published English speech, by using a huge array of computing power to precompute various answers and sift them. It is a bit like “solving checkers” and then claiming “wow, a dog could have done this”. It is like making a cheat sheet for a test by analyzing all answers ever given, and then summarizing them in a vector of 102827 dimensions, and claiming that it is the same as coming up with clever and relevant one liners on the spot using the brain of a dog. NO. It’s not nearly as astounding or impressive.
- shagie 5y agoBunny is a neat dog... https://www.youtube.com/channel/UCEa46rlHqEP6ClWitFd2QOQ https://www.youtube.com/channel/UCEa46rlHqEP6ClWitFd2QOQ The vocal apparatus is not there, but there is certainly more cognition than what people think dogs have (there's a question that I wonder if language enables thought or if thought enables language) And this is even something that a cat can do (not as much language skills, but there's thought going on) https://www.youtube.com/c/BilliSpeaks https://www.youtube.com/c/BilliSpeaks
- qnsi 5y agoI saw a lot of videos about this Bunny dog on tiktok, but discarded it as a gimmick, not believing it's real. Your comment motivated me to look into it more (30 seconds of time). This NYT article at least does not discredit it [0]. Have you looked more into it? Do you think it would be useful to train your dog to do it? [0]https://www.nytimes.com/2021/05/27/style/bunny-the-dog-animal-communication.html https://www.nytimes.com/2021/05/27/style/bunny-the-dog-anima...
- shagie 5y agoWith my cat (I've got the buttons, haven't done anything with them yet) its would be useful to find out if he wants food, attention, or is complaining about the water bowl or litter box. Even being able to distinguish those would be a "win". The Bunny video that I still find the most useful communication is https://youtu.be/6MMGmRVal6M https://youtu.be/6MMGmRVal6M
- sinuhe69 5y agoI like to see how AlphaCode will solve a problem no human has solved before (or very unlikely). For example, given 3 beads and 2 stacks for the 10er and 1er positions of a number. One can make 4 different numbers when stack all the beads like in an abacus. Without using all the beads, one can of course make more numbers. The question is how many different numbers one can make using n beads, giving full and partial usage of the beads. It's indeed a very simple problem for 5-7 year olds and I hardly think anyone cannot solve it. Nevertheless, I seriously doubt AlphaCode can solve the problem. What does it say about its supposed Intelligence?
- recursive 5y agoWhy do you think that's more difficult than the backspace question? I see no reason to doubt AlphaCode can solve it.
- 37ef_ced3 5y agoBecause the backspace question (essentially: is T a subsequence of S with a deletion size of N?) probably occurs hundreds of times, in one form or another, within AlphaCode's training corpus. Any leetcode grinder can tell you there are a few dozen types of competitive programming problem (monostack, breadth-first state search, binary search over solution space, etc.) so solutions to new problems are often very similar to solutions for old problems. The training corpus for these code transformers is so large that almost all evaluation involves asking them to generate code from the training corpus. To evaluate CoPilot, we should ask questions that are unusual enough they can't be answered through regurgitation of the training corpus. What does CoPilot generate, given this prompt: // A Go function to set the middle six bits of an unsigned 64-bit integer to 1. Here is a human solution: func six1s(x uint64) uint64 { const ( ones = uint64(63) shift = (64 - 6) / 2 mask = ones << shift ) return x | mask } Can it solve this simple but unusual problem?
- notamy 5y ago> What does CoPilot generate, given this prompt: Here's what it generated for me: // A Go function to set the middle six bits of an unsigned 64-bit integer to 1. func set6(x uint64) uint64 { return x | 0x3f }
- deleted 5y ago[deleted]
- darepublic 5y agoDid I read correctly that the AI generates millions of potential solutions per question and then filters these down? That's an interesting approach and one that had occurred to me. Have a critic evaluate AI generates content and then have it take many tried to come up with a sample that passes the evaluator
- CTmystery 5y agoAmazing stuff for sure. Looking at the example on page 59, though, I certainly see a description that contains sufficient information to implement against. I read this, and then I jump back into the tech spec that I'm writing to find: (1) The product specification and use cases are so poorly defined that I need to anticipate the use cases, design a system that is general enough to accommodate them, and implement it in a way that is easily changeable to accommodate the future departures from my assumptions. (2) As I do this, I need to consider the existing systems that I'm building on top of to ensure there is no regression when this feature rolls out (3) I consider the other teams that are doing similar work and make judgement calls about whether to write independent systems that do one thing each, or to collaborate on a general-enough system with multiple team ownership. (4) The tech that I use to implement this must be within the narrow slice of company-sanctioned tech. (5) I weigh constant tradeoffs on speed to market, maintainability and ownership. I'm sure there's more, but this stuff is _hard_. If autonomous driving for white collar work is coming, as put forth by comments here, I'd like to see indications that the actual hard part of the job is in jeopardy of being executed effectively. Maybe I don't want to believe it, so I can't see it. I'll grant that. But I truly do not see it.
- hawkice 5y agoDog speaking mediocre English won't take my job (yet).
- saltcured 5y agoI debated where in the whole thread, if anywhere, to comment that it is unfair to call it a dog. It is unfair to dogs, and misleading to any human trying to form useful abstractions about it. It lacks any of the dog's general intelligence and social skill which are integral to how we humans think about the sophistication of a dog and understand its adaptability and utility. To me, it is about as accurate as characterizing a mannequin as a monkey with mediocre fashion skills. But, your post makes me realize that a job could be threatened by an AI just superficially emulating a worker, because its existence might exploit the social vulnerabilities of the workplace, in spite of having no general intelligence nor exploitative social skills of its own.
- baron816 5y agoFun fact: dogs bark primarily to communicate with humans. Wolves (undomesticated dogs) don’t really bark. And you wouldn’t likely see a pack of dog barking at each other. But humans are keenly able to tell what a dog is trying to express by the different sounds it makes. This is all a result of the convolution between the two species.
- kovek 5y agoThe article doesn’t seem to discuss much about dogs?
- Jack000 5y agoI think this type of model will have a massive impact on the software industry. 99% of programming tasks in the wild don't involve any kind of algorithmic design, but are more like making a CRUD pattern, writing SQL queries etc. This kind of work is easier to automate but more difficult to source the training data. If and when these models are applied to more mundane problems, I'd expect immediately better performance and utility. We're also in the very very early days of code generation models. Even I can see some ways to improve AlphaCode: - the generate->cluster->test process feels like a form of manual feature engineering. This meta layer should be learned as well, possibly with RL - programming is inherently compositional. Ideally it should perform the generate->cluster->test step for each function and hierarchically build up the whole program, instead of in a single step as it does now - source code is really meant for humans to read. The canonical form of software is more like the object code produced by the compiler. You can probably just produce this directly
- keewee7 5y agoIt's interesting that AI is being aggressively applied to areas where AI practitioners are domain experts. Think programming, data analysis etc. We programmers and data scientists might find ourselves among the first half of knowledge workers to be replaced and not among the last as we previously thought.
- np- 5y ago> We programmers and data scientists Instead of semantically correct Python, programmer and data scientists’ jobs will be to work in semantically correct English. Fundamentally the job won’t change (you’ll be programming the AI rather than program the machine directly).
- axg11 5y agoCompilers didn't replace any jobs, they created more. Similarly, this type of AI-assisted programming will allow more people to program and make existing programmers more productive.
- 5y ago
- indicisive 5y agoFrankly asking a computer to write code is like asking a dog to speak facts in straight zfc. What else can I say, ai research has conspired to take over all other areas of computer science. I wonder who exactly started this hype. Also what else will come after this the stupid ai craze.
- qualudeheart 5y agoIf we hit another AI winter the next big thing would be new/better energy sources and space travel. 3d printing will also enable a return to local scale manufacturing. Crypto will devour more industry. We’ll have mostly automated local factories producing whatever you need and be able to sell it for untraceable crypto. I want that to happen because it will enable resistance movements against the misaligned AI that will inevitably emerge. I model misaligned AI as like an imperialist state. It’s impossible for a single power to conquer the world because every other state allies against it. That will be how AI alignment is solved.
- ilove196884 5y ago
- Andrex 5y agoMan, I wish dogs could talk. Any moonshots working on this yet?
- sdenton4 5y agoCheck out 'Interspecies Internet.' It's kind of a dumb name imo, but the goal is exactly interspecies communication. https://www.interspecies.io/ https://www.interspecies.io/
- danielovichdk 5y agoWhy do we write code ? Code is not a goal. It's a tool. The tool can get better. But it will always be a tool and someone has to control the tool. Writing code is super easy. It's the easiest part of our job. The hard part of our jobs is to understand why we need to write code and right along that, what we write code for ? Maintenance Structuring Domain knowledge Refactoring Those are hard things to do. And they are not solved by having a program writing code for you.
- machiaweliczny 5y agoI think Refactoring will be hardest but Maintenance, Structuring and Domain it's all that even current Codex is good at. I think with current generation of algos we can get to very good google searches but ones that you can throw own documents/code at. Later probably also DB schema etc.
- MauranKilom 5y ago> It's the easiest part of our job. Yep. Some efficiency gain is surely possible with "intelligent" autocomplete (i.e. codex instead of intellisense), but it must be code you wanted to write. "If you think you're paying me for typing code, maybe you should have hired a typist and not a programmer?"
- deleted 5y ago[deleted]
- arpa 5y agoHey it sure feels nice to know that now a "dog" is much more clever than me. but then again, its approach is so vastly different that it makes it really incomparable with our typical modus operandi. It's throwing millions of monkeys into millions of typewriters and actually producing "to be or not to be" reliably. I don't see AI writing Shakespeare in my lifetime though (I hope to die rather soon).
- mirceal 5y agoon the internet everyone is a dog that speaks mediocre english. especially AI bots!
- mirceal 5y agothis is cool and all but it’s not even close to AGI. it’s a sophisticated gimmick. to go meta, I don’t believe that our way of approaching AI in general is going to get us to AGI. Why? Assume for a second that we could build something that could solve ANY problem. What would happen next? What does an intelligent human with zero emotions do? Nothing. Fear of dying and the hardwired desire to pass on our genes (or to contribute something to society - which is just another way of shooting for immortality) is what drives us. I predict that true AGI cannot come before a machine that has feelings, that is sentient. We already have machines that do that. They’re called humans. It’s very arrogant of us thinking we can recreate in silicon what nature has evolved over eons. Not saying it’s not gonna happen - but not with the current approaches. Also, a dog that speaks mediocre english? please. this is insulting to dogs and shows out tendency to anthropomorphize everything.
- Smoosh 5y agoI agree with your underlying premise - without stimuli such as pain and pleasure to give motivation it is difficult to foresee an AI which will think enough like humans to be useful or that we feel we can trust. But perhaps that is just chauvinism.
- mirceal 5y agogeneralized problem solving could be useful but it’s still going to be a tool that augments us. it will not replace us by any means. the game changer is not going to be AGI, it’s going to be human/machine symbiosis
- YeGoblynQueenne 5y ago>> Update: A colleague of mine points out that one million, the number of candidate programs that AlphaCode needs to generate, could be seen as roughly exponential in the number of lines of the generated programs. To clarify, "one million" is the number of programs generated by AlphaCode on the CodeContests dataset, not the CodeForces one (although the former is a superset of the latter). The results on CodeContests are reported in table 5 (page 15 of the pdf) of the DeepMind preprint [1]. The results on CodeForces are reported in table 4 of the preprint (page 14 of the pdf). I can't find where the paper lists the number of samples drawn for the CodeForces results, but on Section 4.4 the preprint says: Sampling from transformer models can be easily parallelized, which allowed us to scale to millions of samples per problem (...). Note the plural. "Millions" can mean one million, or a hundred million, but, as far as I can tell, the preprint never makes it clear which it is. Note that the results on CodeForces (table 4) are averaged over 3 evaluations in each of which AlphaCode generated "millions" of samples and finally submitted 10. So it's 3 times "millions" of samples for the actual results in table 4 (CodeForces). I assume those were the top 3 of all evaluations. The idea that the lines of code in a target program are related to the cardinality of the program space that must be searched before a target program can be found is not completely unfounded. For sure, the cardinality of the search space for programs is some function of the number of tokens that must be combined to form each program in that space. An _exponential_ function because we're talking about combinations of tokens (assuming only grammatical strings are generated it gets a bit better, but not by much). We can take lines-of-code as a rough proxy of number of tokens, and in any case it's clear that the cardinality of the set of one-line programs is less than the cardinality of the set of two-line programs, and so on. I'm not sure if the "Update" bit above is claiming, that AlphaCode must generate the _entire_ program space of _all_ k-line programs before it can find a solution to that problem. To be honest, even I don't think that AlphaCode is _that_ bad. Having to go through the entire program space to find one program is the worst case. On the other hand, AlphaCode does perform very poorly so who knows? Regarding talking dogs, I have never met any, but I have heard of a horse that can do arithmetic [2]. __________ [1] https://storage.googleapis.com/deepmind-media/AlphaCode/competition_level_code_generation_with_alphacode.pdf https://storage.googleapis.com/deepmind-media/AlphaCode/comp... [2] https://en.wikipedia.org/wiki/Clever_Hans https://en.wikipedia.org/wiki/Clever_Hans
- jonas_kgomo 5y agoI am so terrified right now about the implications of this to a regular software engineer like myself. In 10 years we would be totally dispensable
- machiaweliczny 5y agoWorry not. If real programming (where there's no easily available tests) is automated then everything else probably is as well.
- killerstorm 5y agoA lot of people who are skeptical about AI progress call it "statistical modeling" and point to large data sets involved and large amounts of hardware thrown at it. Sort of implying it's some sort of a brute-force trick. I'm afraid they do not understand the size of problem/solution set. Suppose problem and solution are 1000 characters long and there's a set of 32 characters. Then a model is function F: X -> X where X is a set of 2^5000 elements. There are 2^10000 such functions, and the goal of a training process is to find the best one. Training set for a language model would be well under 1 PB. So a task here is to use a training set of size 2^50 to find a function from 2^10000 space. It's obvious that no amount of brute-forcing can possibly find this. An no classic mathematical statistical modeling can possibly help. A problem like this can be only approached via ANNs trained through backpropagation, and only because this training process is known to generalize.
- runarberg 5y agoWe are still inferring a best fit based on available data, so “statistical modelling” is way more descriptive of what we are doing the “intelligence”. That doesn’t mean it isn’t impressive. These non-classical statistical inference are going beyond what we have been able to do with classic statistics, it is indeed impressive. Personally I only grow skeptical when claims are made about some vague Artificial General Intelligence or some other magic which no amount of inference is gonna give us.
- machiaweliczny 5y agoI think diff inference might give us that. Basically kinda like dreaming(generating) other samples and checking how they are different. This will help understand how thing is defined but maybe it works for all kind of things. Obviously it's tough to find such algorithm that works for all types of data/embeddings.
- killerstorm 5y agoGiven that NN components are demonstrated to have universal computation properties, it is more like deriving a program from training data. Technically a program here is a 'curve' but it's insanely complex one. Do you consider programming math? Since technically you write a function which deals with 0s and 1s.