6 ms·
This article of course presents automatic programming as if it's a brand new thing that is only now possible to do thanks to "AI", but that is only how companie
by YeGoblynQueenne 5y ago
This article of course presents automatic programming as if it's a brand new
thing that is only now possible to do thanks to "AI", but that is only how
companies that sell the technology find it convenient to present things to
market their products. The thing to keep in mind is that program synthesis is an
old field and a lot of progress has been made that is completely ignored by the
article. Of course most people haven't even heard of "program synthesis" in the
first place, simply because it is not as much hyped as GPT-3 and friends.
From my point of view (my field of study is basically program synthesis for
logic programs) code generation with large language models is not really
comparable to what can be achieved with traditional program synthesis
approaches.
The main advance seems to be in the extent to which a natural language (i.e.
English) specification can be used, but natural language specifications are
inherently limited because of the ambiguity of natural language. Additionally,
trying to generate new code by modelling old code has the obvious limitation
that no genuinely new code can be generated. If you ask a language model to
generate code it doesn't know how to generate - you'll only get back garbage.
Because it has no way to discover code it doesn't already know how to write.
So Copilot, for example, looks like it will make a fine boilerplate generator -
and I'm less skeptical about its utility than most posters here (maybe partly
because I'm not worried my work will be automated) but that's all that should
be expected of it.
- montenegrohugo 5y agoHmmm. A few points. First, I've never heard of program synthesis, and it seems like an interesting topic. Could you point me to some resources so I can learn more about it? Second. I take issue with this statement: > "trying to generate new code by modelling old code has the obvious limitation that no genuinely new code can be generated" I disagree. We've seen GAN's generate genuinely new artwork, we've seen music synthesizers do the same. We've also seen GPT-3 and other generative text engines create genuinely interesting and innovative content. AI dungeon comes to mind. Sure, it's in one way or another based on it's training data. But that's what humans do too. Our level of abstraction is just higher, and we're able to generate more "distinct" music/code/songs based on our own training data. But that may not hold in the long term, and it also doesn't mean that current AI models can do nothing but regurgitate. They can generate new, genuinely interesting content and connections.
- throwawaygh 5y ago> First, I've never heard of program synthesis, and it seems like an interesting topic. Could you point me to some resources so I can learn more about it? I'll leave it to the GP to give a lit review, but will say that CS has (always had) a hype-and-bullshit problem, and that knowing your history is good way to stay sober in this field. > We've also seen GPT-3 and other generative text engines create genuinely interesting and innovative content. Making things humans find entertaining is easy. Markov chains could generate genuinely interesting and innovative poetry in the 90s. There's a Reply All episode on generating captions for memes or something where the two hosts gawk in amazement at what's basically early 90s tech. > They can generate new, genuinely interesting content and connections. Have you ever dropped acid? You can make all sorts of fascinating content and connections while hallucinating. Seriously -- much more than when you're sober. Probably shouldn't push to prod while stoned, though. Art and rhetoric are easy because there's really no such thing as "Wrong". That's why we've been able to "fake creative intelligence" since the 80s or 90s. Almost all software that people are paid to write today is either 1) incredibly complicated and domain-specific (think scientists/mathematicians/R&D engineers), or else 2) interfaces with the real world via either physical machines or, more commonly, integration into some sort of social processes. For Type 1, "automatic programming" has a loooong way to go, but you could imagine it working out eventually. Previous iterations on "automatic programming" have had huge impacts. E.g., back in the day, the FORTRAN compiler was called an "automatic programmer". Really. For Type 2, well, wake me up there's a massive transformer-based model that only generates text like "A tech will be at your house in 3 hours" when a tech is actually on the way. And that's a pretty darn trivial example. There is a third type of software: boilerplate and repetitive crap. Frankly, for that third type, I think the wix.com model will always beat out the CoPilot model. And it's frankly the very low end of the market anyways.
- dreamcompiler 5y ago> First, I've never heard of program synthesis, and it seems like an interesting topic. Could you point me to some resources so I can learn more about it? Look up the work of Cordell Green. He invented the idea and built a company around it. https://www.kestrel.edu/people/green/ https://www.kestrel.edu/people/green/
- 5y ago
- plutonorm 5y agoSaid all of the vision researchers before they got blown out of the water by convolutions neural networks. Adapt or die.
- charcircuit 5y agoCNNs can't recognize what they haven't been trained on.
- dash2 5y agoHumans can't recognize what they haven't seen either, no?
- testrun 5y agoNot quite the same, show humans one picture of a giraffe and most humans will recognise the animal in different conditions, poses, angles and so on. Any neural net (up till now) has a difficult time doing the same.
- jackcviers3 5y agoIncorrect. Recognition applications have been able to track objects across disparate frames of video even when obscures from camera view, for at least a decade now [1]. 1. https://youtu.be/1GhNXHCQGsM https://youtu.be/1GhNXHCQGsM
- jackcviers3 5y agoAnd what makes the voice in your head can't understand what it says. There are two parts, at least, to sentience: the observer and the actor. In yogic traditions, "you" are the part that "hears" the voice in your head, not the voice itself. I think this, while it may not necessarily be true of "real" minds, has a lot of utility when it comes to designing artificial ones. I think general AI is probably going to be lots of individual parts structured around a central observational unit, which then makes preprogrammed higher level decisions on where to distribute inputs and outputs of several external nn, score the results of it's actions, and then use the results for reinforcement and/NEAT or something similar to improve it's central decision making. This technique of a simple, preprogrammed decision maker given inputs and outputs of stochastic processes is already in use in autonomous navigation (see the GT robotics course on coursera)[1]. The actor doesn't need to understand meaning, the observer assigns meaning to the actions of the actor. 1. "Free Online Course: Control of Mobile Robots from Coursera | Class Central" https://www.classcentral.com/course/conrob-404 https://www.classcentral.com/course/conrob-404
- codetrotter 5y ago> This article of course presents automatic programming as if it's a brand new thing that is only now possible to do thanks to "AI", but that is only how companies that sell the technology find it convenient to present things to market their products. Reminds me of this essay that pg wrote in 2005, titled The Submarine. Someone linked it in another thread here on HN recently. > One of the most surprising things I discovered during my brief business career was the existence of the PR industry, lurking like a huge, quiet submarine beneath the news. Of the stories you read in traditional media that aren't about politics, crimes, or disasters, more than half probably come from PR firms. http://www.paulgraham.com/submarine.html http://www.paulgraham.com/submarine.html
- perl4ever 5y ago>most people haven't even heard of "program synthesis" Since my first programming job, I've generated code in whatever language I'm using with that language. SQL from SQL, Perl from Perl, etc. And/or regular expressions. This page: https://en.wikipedia.org/wiki/Metaprogramming https://en.wikipedia.org/wiki/Metaprogramming leaves the impression that using programs to make programs requires a special language or special features, and it was rather a dead end in AI.
- YeGoblynQueenne 5y agoMetaporgramming is a technique that can be used for program synthesis, but it is not the same as program synthesis. In program synthesis you generate a program from a specification that can be more or less complete, for instance it can be an entire program written in some formal language, or it can be a set of input-output examples of the target program etc. Synthesisers typically search a space of programs (a set of strings in the target language) for a program that satisfies the specification. I think what you describe is the task of putting together parts of a program according to a configuration. That's a related task and you could certainly see it as a kind of program synthesis, but because it's a common task that we know how to do well, it's not really what program synthesis research is focused on. Some programming languages are definitely better suited to program synthesis than others. That's particularly the case with languages that have little of what I'd call "ceremony", syntax that's not really necessary to express the behaviour of a program, but are there to help the programmer organise the code, such as classes, maybe, or interfaces, say. I don't know that metaprogramming was a dead end in AI. I hear that a lot for many subjects of AI research that are still active. I mean, if you asked machine learning researchers ten years ago about neural networks they'd tell you "it's a dead end", or "we tried that and it didn't work" etc. So, unless you're very knowledgeable about a subject of AI research my suggestion is to be cautious when extracting conclusions from a perfunctory perusal of wikipedia or blog posts etc. That's not where most of the knowledge is stored for such deep subjects as AI research.
- perl4ever 5y ago>Synthesisers typically search a space of programs (a set of strings in the target language) for a program that satisfies the specification. This sounds like a description of a parser generator.
- moyix 5y agoI think it's inevitable that program synthesis will adopt deep learning methods, whether or not those look like large language models. There's been a bunch of work on this (that you're probably familiar with) from Dawn Song's group: https://sunblaze-ucb.github.io/program-synthesis/index.html https://sunblaze-ucb.github.io/program-synthesis/index.html I think of large LMs trained on code as something that will sample strings from the space of "code humans might write". This isn't nothing, but as you say it's unlikely to produce programs that solve problems no human has solved before. However, assuming you have a rigorous enough spec, I don't see why you couldn't use something like reinforcement learning on such a model in conjunction with traditional verification tools... Anyway, I agree it's unfortunate that program synthesis has been overlooked in the latest AI code generation craze -- I've mentioned it to a few journalists when talking about things like Copilot but it doesn't tend to end up in the final article.
- le-mark 5y ago> However, assuming you have a rigorous enough spec, And thus the ball is moved back to the human programmers court, as it has since Cobols sentences and paragraphs were supposed to allow managers and business analyst to write code.
- moyix 5y agoThis is pretty much already assumed by program synthesis work AFAIK. There's also work on synthesis from I/O samples (e.g. FlashFill) but you don't get very good guarantees (and sometimes it makes hilarious mistakes: https://i.redd.it/c4lufe3m6jh21.gif https://i.redd.it/c4lufe3m6jh21.gif ).
- YeGoblynQueenne 5y agoActually, FlashFill is quite impressive- maybe it doesn't always get it right but it's true one-shot learning (rather than one-shot after billion-shot learning) that works very well most of the time. I'm actually surprised about the Maruary, Apruary etc error. That is something that FlashFill should be able to handle very well. Strange. Do you have a link to some post or comment etc with more context about that gif? Maybe it was an older version of the tool? It works correctly (generates month names) in my version of Excel (360 I think?). Although I do see the Maruary etc error while I fill-in "February" (but not after I drag the cross-handle thingy down).
- bglazer 5y agoAlways happy to see a comment from YeGoblynQueenne on a program synthesis post. I’m optimistic about the prospects of some combination of logic solvers and deep learning. As you mention, natural language specs are only approachable with a language model. I think logical constraints could function as really powerful regularization on the output of neural network code gen. Like, constraining output to only programs that satisfy logical constraints inferred from the language. Also, some forms of programming are super non-trivial to describe and are much more easily specified with input output pairs. This is where the more traditional synthesis approaches really shine. Excel flashfill works astoundingly well for this.
- YeGoblynQueenne 5y agoThanks for the endorsement :) >> Also, some forms of programming are super non-trivial to describe and are much more easily specified with input output pairs. I agree of course, but then I would, wouldn't I? That's the kind of thing I'm studying... The Gulwani et al. work behind FlashFill made a huge impression in program synthesis circles when it first came out.