4 ms·

> the LLMs will ship code the LLMs understand, and whether any human specifically understands any particular part will mostly not matter. I find this particula

> the LLMs will ship code the LLMs understand, and whether any human specifically understands any particular part will mostly not matter. I find this particularly funny. There were more than a couple Star Trek Episodes where some alien planet depends on some advanced AI or other technology that they no longer understand, and it turns out the AI is actually slowly killing them, making them sterile, etc. (e.g. https://en.wikipedia.org/wiki/When_the_Bough_Breaks_(Star_Trek:_The_Next_Generation) https://en.wikipedia.org/wiki/When_the_Bough_Breaks_(Star_Tr... ) Sure, Star Trek is fiction, but "humans rely on a technology that they forget how to make" is a pretty recurrent theme in human history. The FOGBANK saga was pretty recent: https://en.wikipedia.org/wiki/Fogbank https://en.wikipedia.org/wiki/Fogbank It just amazes me that people think "Sure, this AI generated code is kinda broken now, but all we need is just more AI code to fix it at some unknowable point in the future because humans won't be able to understand it!"

randallsquared 6mo ago
If you'd told me 20-30 years ago we'd actually get the Star Trek computer in the mid-2020s and it still wouldn't be actually AGI, I would have thought that very strange and unlikely, so who knows?
- reverius42 6mo ago
  > wouldn't be actually AGI Not sure that's going to age well.
  - randallsquared 6mo ago
    Well, I meant existing or previous here in May 2026, though "mid-2020s" could definitely be interpreted to mean 2023-2027 or so.
snapcaster 6mo ago
So nothing about the last 3 years has caused you to update your beliefs on this stuff? feels like bitter cope
preisschild 6mo ago
> It just amazes me that people think "Sure, this AI generated code is kinda broken now, but all we need is just more AI code to fix it at some unknowable point in the future because humans won't be able to understand it!" This is not even limited to code. I've seen people justifying AI datacenters using fossil fuels because AI will solve fusion power plants at some unknowable point in the future.

randallsquared 6mo ago

If you'd told me 20-30 years ago we'd actually get the Star Trek computer in the mid-2020s and it still wouldn't be actually AGI, I would have thought that very strange and unlikely, so who knows?

reverius42 6mo ago
> wouldn't be actually AGI Not sure that's going to age well.
- randallsquared 6mo ago
  Well, I meant existing or previous here in May 2026, though "mid-2020s" could definitely be interpreted to mean 2023-2027 or so.

snapcaster 6mo ago

So nothing about the last 3 years has caused you to update your beliefs on this stuff? feels like bitter cope

preisschild 6mo ago

> It just amazes me that people think "Sure, this AI generated code is kinda broken now, but all we need is just more AI code to fix it at some unknowable point in the future because humans won't be able to understand it!" This is not even limited to code. I've seen people justifying AI datacenters using fossil fuels because AI will solve fusion power plants at some unknowable point in the future.