4 ms·

One thing that makes me depressed about ChatGPT is that the software engineering behind it is not some 1996 Doom Carmack style wizardry. It's attention mechani

One thing that makes me depressed about ChatGPT is that the software engineering behind it is not some 1996 Doom Carmack style wizardry. It's attention mechanisms, a transformer architecture, and lots and lots and lots of data. The data does all the programming. I look at a lot of AI projects and there's not a lot of code. Sure it takes a lot of work to understand it, but in the end it's not a lot of code. This makes me think that in the future programming will be just about collecting data and then doing things with the data. We will all be data generators and collectors with a few math PHDs in the middle working on the activation functions and so forth. The rest of us will be stringing models together Stable Diffusion style or writing the billing code.

thatguyagain 4y ago
Feels good for some reason knowing that Carmack himself is working on AI from a different angle :) https://dallasinnovates.com/exclusive-qa-john-carmacks-different-path-to-artificial-general-intelligence/ https://dallasinnovates.com/exclusive-qa-john-carmacks-diffe...
- freilanzer 4y ago
  > And he gave me a list of like 40 research papers and said, ‘If you really learn all of these, you’ll know 90% of what matters today.’ Is there any info on what these papers are?
  - CatWChainsaw 4y ago
    Try searching HN. There were recently a couple posts asking about these 40 papers.
    - freilanzer 4y ago
      I found the threads in the meantime, but there does not appear to be any new information as of yet.