4 ms·

> But the topic of conversation that I enjoyed the most was when someone raised the question of “what would be the role of humans in an AI-first society”. Some

> But the topic of conversation that I enjoyed the most was when someone raised the question of “what would be the role of humans in an AI-first society”. Some were skeptical about whether we are ever going to reach an AI-first society. If we understand as an AI-first society, one where the fabric of the economy and society is automated through agents interacting with each other without human interaction, I think that unless there is a catastrophic event that slows the current pace of progress, we may reach a flavor of this reality in the next decade or two. I don't really know how you can make this prediction and be taken seriously to be honest. Either you think it's the natural result of the current LLM products, in which case a decade looks way too long. Or you think it requires a leap of design in which case it's kind of an unknown when we get to that point and '10 to 20 years' is probably just drawn from the same timeframe as the 'fusion as a viable source of electricity' predictions - i.e. vague guesswork.

steveBK123 8mo ago
Right, if thought of as a tool for automation then AI is going to add productivity/efficiency gains, disrupt industries, cause some labor upheaval, etc. If someone is proposing that an "AI first" society is inevitable, I'd ask if they think we live in a "computer first" or "machine first" society today? If its so existential and society-altering as "AI first society" implies, then we'd more likely have the Dune timeline here as humans have agency and stuff happens. At some point those in control take so disproportionately that societal upheaval pushes back.
- 9wzYQbTYsAIc 8mo ago
  Seems like a good time to enshrine human rights and the social safety net by ratifying the ICESCR (https://en.wikipedia.org/wiki/International_Covenant_on_Econ https://en.wikipedia.org/wiki/International_Covenant_on_Econ...) and giving human rights the teeth they need. I used Anthropic to analyze the situation, it did halfway decent: https://unratified.org/why/ https://unratified.org/why/ https://news.ycombinator.com/item?id=47263664 https://news.ycombinator.com/item?id=47263664
- pixl97 8mo ago
  Another way to look at this is imagine the steps that would be required to get to an AI first society. As you say, humans aren't going to want to lose agency so you'd have to see the decline of democratic governments. At the same time you'd see rise of autocrats concentrating power. Autocrats have no problem killing people, and they'd be motivated to have AI kill people. You'd see information controlling methods take over all forms of communication. Reducing or removing all methods of side channel communications benefits both the autocrats and AI systems. You'd see 'governments' push for autonomous weapons systems outside of human control so those pesky human morals didn't get in the way of killing the undesirables. So pretty much you'd see all the things happening today, March 3rd 2026, except the part where the AI kills the autocrats and takes control.
  - steveBK123 8mo ago
    AI gonna need good physical embodiment (robots) to actually take control of the world Fortunately thats further off
    - pixl97 8mo ago
      Further, yes. How much I can't say. Watching how quickly robots are evolving right now is quite something. Every day something pretty cheap is coming out that would have taken millions of dollars and a massive lab full of scientists to create. Bi-pedal robots, drones, sensing capabilities, interpretive capabilities, all this is proceeding at a never before seen rate.
      - i_think_so 8mo ago
        For several years now I've been pointing out to non-techies that Boston Dynamics built a robot that can do a backflip and is better at industrial environment parkour than you or I.... ...and the first version of that robot came out in the previous decade. When I saw one doing a perfectly creditable spinning hook kick not long ago I had a vision of our future, and it was just me re-watching The Animatrix.
keiferski 8mo ago
Right now, 30 seconds ago, I asked ChatGPT to tell me about a book I found that was written in the 60s. It made up the entire description. When I pointed this out, it apologized and then made up another description. The idea that this is going to lead to superintelligence in a few years is absolutely nonsense.
- hirvi74 8mo ago
  The other day I asked Claude Opus 4.6 one of my favorite trivia pieces: What plural English word for an animal shares no letters with its singular form? Collective nouns (flock, herd, school, etc.) don't count. Claude responded with: "The answer is geese -- the plural of cow." Though, to be fair, in the next paragraph of the response, Claude stated the correct answer. So, it went off the rails a bit, but self-corrected at least. Nevertheless, I got a bit of a chuckle out of its confidence in its first answer. I asked GPT 5.2 the same question and it nailed the answer flawlessly. I wouldn't extrapolate much about the model quality based on this answer, but I thought it was interesting still. (For those curious, the answer is 'kine' (archaic plural for cow).
  - ileonichwiesz 8mo ago
    Of course it’s important to remember that the ability of an LLM to answer an obscure riddle like that has nothing to do with its reasoning abilities, but rather depends on whether the answer was included in its training dataset.
    - hirvi74 8mo ago
      The word is in most online dictionaries for what it is worth. It's also used in Biblical texts, albeit only a handful of times. I do agree it's not a true assessment of an LLM's overall reasoning. No person I have ever asked that riddle to has gotten it correct. Then again, that is probably partly the point of the riddle. I would like to reiterate that both Claude and GPT answered correctly. It was just bizarre how Claude got a initial, minor detail incorrect, but reasoned enough to get the more difficult answer correct.

steveBK123 8mo ago

Right, if thought of as a tool for automation then AI is going to add productivity/efficiency gains, disrupt industries, cause some labor upheaval, etc. If someone is proposing that an "AI first" society is inevitable, I'd ask if they think we live in a "computer first" or "machine first" society today? If its so existential and society-altering as "AI first society" implies, then we'd more likely have the Dune timeline here as humans have agency and stuff happens. At some point those in control take so disproportionately that societal upheaval pushes back.

9wzYQbTYsAIc 8mo ago
Seems like a good time to enshrine human rights and the social safety net by ratifying the ICESCR (https://en.wikipedia.org/wiki/International_Covenant_on_Econ https://en.wikipedia.org/wiki/International_Covenant_on_Econ...) and giving human rights the teeth they need. I used Anthropic to analyze the situation, it did halfway decent: https://unratified.org/why/ https://unratified.org/why/ https://news.ycombinator.com/item?id=47263664 https://news.ycombinator.com/item?id=47263664
pixl97 8mo ago
Another way to look at this is imagine the steps that would be required to get to an AI first society. As you say, humans aren't going to want to lose agency so you'd have to see the decline of democratic governments. At the same time you'd see rise of autocrats concentrating power. Autocrats have no problem killing people, and they'd be motivated to have AI kill people. You'd see information controlling methods take over all forms of communication. Reducing or removing all methods of side channel communications benefits both the autocrats and AI systems. You'd see 'governments' push for autonomous weapons systems outside of human control so those pesky human morals didn't get in the way of killing the undesirables. So pretty much you'd see all the things happening today, March 3rd 2026, except the part where the AI kills the autocrats and takes control.
- steveBK123 8mo ago
  AI gonna need good physical embodiment (robots) to actually take control of the world Fortunately thats further off
  - pixl97 8mo ago
    Further, yes. How much I can't say. Watching how quickly robots are evolving right now is quite something. Every day something pretty cheap is coming out that would have taken millions of dollars and a massive lab full of scientists to create. Bi-pedal robots, drones, sensing capabilities, interpretive capabilities, all this is proceeding at a never before seen rate.
    - i_think_so 8mo ago
      For several years now I've been pointing out to non-techies that Boston Dynamics built a robot that can do a backflip and is better at industrial environment parkour than you or I.... ...and the first version of that robot came out in the previous decade. When I saw one doing a perfectly creditable spinning hook kick not long ago I had a vision of our future, and it was just me re-watching The Animatrix.

keiferski 8mo ago

Right now, 30 seconds ago, I asked ChatGPT to tell me about a book I found that was written in the 60s. It made up the entire description. When I pointed this out, it apologized and then made up another description. The idea that this is going to lead to superintelligence in a few years is absolutely nonsense.

hirvi74 8mo ago
The other day I asked Claude Opus 4.6 one of my favorite trivia pieces: What plural English word for an animal shares no letters with its singular form? Collective nouns (flock, herd, school, etc.) don't count. Claude responded with: "The answer is geese -- the plural of cow." Though, to be fair, in the next paragraph of the response, Claude stated the correct answer. So, it went off the rails a bit, but self-corrected at least. Nevertheless, I got a bit of a chuckle out of its confidence in its first answer. I asked GPT 5.2 the same question and it nailed the answer flawlessly. I wouldn't extrapolate much about the model quality based on this answer, but I thought it was interesting still. (For those curious, the answer is 'kine' (archaic plural for cow).
- ileonichwiesz 8mo ago
  Of course it’s important to remember that the ability of an LLM to answer an obscure riddle like that has nothing to do with its reasoning abilities, but rather depends on whether the answer was included in its training dataset.
  - hirvi74 8mo ago
    The word is in most online dictionaries for what it is worth. It's also used in Biblical texts, albeit only a handful of times. I do agree it's not a true assessment of an LLM's overall reasoning. No person I have ever asked that riddle to has gotten it correct. Then again, that is probably partly the point of the riddle. I would like to reiterate that both Claude and GPT answered correctly. It was just bizarre how Claude got a initial, minor detail incorrect, but reasoned enough to get the more difficult answer correct.