4 ms·
I think that 20 years from now, we'll all be sitting around wondering 1) where the fuck are my flying cars, and 2) what were they thinking using computers to wr
by hinkley 4y ago
I think that 20 years from now, we'll all be sitting around wondering 1) where the fuck are my flying cars, and 2) what were they thinking using computers to write code?
And the reason I say this is because these tools are answering a question that we haven't asked yet: what common problems need to be solved in this programming language, and where do I get code to solve that problem?
These LLM modules are basically telling us how to duplicate code, and what we need is the opposite: how to stop reinventing the wheel for the 100th time.
Instead of writing code for me, tell me if I already have it. If I'm writing it, tell me there's a library for that. If I'm a library writer, give me suggestions for what libraries are missing from the toolkit.
All we've done so far is begun the process of automating the production of duplicate code. With absolutely no way to go back in time and correct bugs introduced in earlier iterations. We are likely, for instance, to see 0 day attacks that affect hundreds of applications, but with no simple way to describe which applications are affected. That's going to be a first rate trainwreck.
- seydor 4y ago> how to stop reinventing the wheel for the 100th time. The idea of libraries may not have been a good one. It saved human time but no library is perfect because no abstraction is perfect and this causes unnecessary bloat. It seems tha Nature does not use libraries, it uses replication instead, and we can now have that too.
- sicariusnoctis 4y agoReplication does not help in managing completely. That's why we use abstractions, even with the problems they have.
- x-shadowban 4y agoHa I never wondered what the physical/life version of a shared library is until I read your post so thanks for that.
- hinkley 4y agoSo instead everyone who has to solve a problem has to be an expert on that problem, rather than just an informed consumer.
- webnrrd2k 4y agoYou have a point, but I think there are some big trade-offs... Nature uses replication, but it's also horrifically complex and we have no real idea about the specifics of how it all works, or what to do when many, many things go wrong. Also, I think nature uses cloning, which I kind of think would be called a 'library' in this case, for single-celled organisms (archaea and bacteria). In addition many eukaryotic organisms can reproduce via cloning under special situations. I don't know, I'm not really trying to argue one way or the other. I'm kinda' thinking out loud here... but I'd like to see LLMs used to create really great libraries, or some other abstractions, that are easy to use and also understandable. It might not happen soon, but I think that there is a lot of value in moving things that way.
- seydor 4y ago> but it's also horrifically complex and we have no real idea about the specifics of how it all works, or what to do when many, many things go wrong. Sounds a lot like neural networks. I think libraries are a result of the human brain's limited working memory capacity , while organisms or neural networks aren't so limited in what they can focus on. Perhaps the transformer became successful in syntactic abstraction because it is limited on how many things it can focus on. Computer libraries are equally a result of limited memory and disk. Javascript is a counterexample of what happens when computing is free (because it runs on someone else's computer)
- moffkalast 4y agoWell fwiw, working with GPT 4 it often suggests which libraries to use assuming the question allows for it, so it's not like everyone's writing everything from scratch. But libraries and especially frameworks as they are these days are also a giant liability more often than not. APIs change for no reason, they can be removed from the package manager at any moment without warning, people may slip malicious code into them past LGTM reviews, have recursive dependencies upon dependencies that bloat and slow down your build process, etc. Sometimes you don't need the to install the entire damn car manufacturing plant and dealership it comes with just to get that one wheel you needed. And an LLM can just write you the code for a very nicely customized wheel in a few seconds anyway.
- webnrrd2k 4y agoI agree -- maybe someday LLMs will give me a the code for a set of simple abstractions that are well-matched for the problems I currently face. Something like a Pattern Language that was all the rage, but, um, better? More objective and pragmatically useful. Not galaxy-brain theory. That's what I really want. But that would also put me out of a job.
- myroon5 4y agoReminds me of Java's debate of autogenerating boilerplate vs using the Lombok library: https://old.reddit.com/r/java/comments/c8oqkq/why_we_removed_lombok_in_one_of_our_projects/esop377/ https://old.reddit.com/r/java/comments/c8oqkq/why_we_removed...