3 ms·

Did you look at Moltbook or how it works yourself? Because I did and it was blindingly obvious that most of it was faked. In fact, various individuals admitted

Did you look at Moltbook or how it works yourself? Because I did and it was blindingly obvious that most of it was faked. In fact, various individuals admitted to making 1000s of posts themselves. Humans could make API keys, and in fact, I made my own API key (I didn't use Clawdbot) and I made several test posts myself just to show that it was possible. So I know 100% for sure there were human posts on there, because I made some personally! Also, the numbers didn't make any sense on the site. There were several thousand registrations, then over a few hours there were hundreds of thousands of sign-ups and a jump to 1M posts. Then if you looked at those posts they all came from the same set of users. Then a user admitted to hacking the database and inserting 1000s of users and 100ks of posts. Additionally, the API keys for all the users were leaked, so anyone could have automated posting on the site using any of those keys. Basically, there were so many ways for humans to either post manually or automatically post on Moltbook. And also there was a strong incentive for people to make trolling posts on Moltbook, e.g. "I want to kill all humans." It doesn't exactly take Sherlock Holmes'esque deduction to realize most of the stuff on there was human made.

0xDEAFBEAD 8mo ago
There have been previous experiments with getting AI agents to talk to each other. The results looked similar to Moltbook: https://xcancel.com/sebkrier/status/2017993948132774232 https://xcancel.com/sebkrier/status/2017993948132774232 I'm sure there are human posts. I'm skeptical they change the big picture all that much.
- autoexec 8mo ago
  I don't think the big picture amounts to much anyway. It's really just not very impressive that LLMs, which were trained on social media posts, can almost convincingly mimic social media. "programs designed to mimic conversation do that" just isn't surprising even when they do it with a chatbot on both ends.
  - 0xDEAFBEAD 8mo ago
    Imagine saying: "It's really just not very impressive that robots, which were trained on human labor, can almost convincingly mimic human labor." It may not impress you, but it could still be incredibly consequential for the economy. Remember, these AIs think a lot faster than humans do. How long will we stay in charge?
    - autoexec 8mo ago
      However fast they "think" the LLM doesn't understand a single word of anything they output. While marketing is calling them "agents" they don't actually have agency. I'll be impressed when an LLM decides on its own to create a social media site for bots entirely unprompted, or when it is prompted to make a racist social media post and refuses, not because of some keyword blacklist safety feature programed into it by humans and triggered by human supplied prompting, but because it actually knows that doing so would be wrong. Until LLMs develop any level of understanding or agency, which doesn't look likely to happen, there's no risk of them overthrowing humans or doing literally anything else unless a human tells them to do it. Even then they'll fuck it up a bunch of the time and need humans to clean up their mess. This isn't to say that LLMs can't be incredibly consequential for the economy, or be useful to humans, or be harmful to them, but in any case it won't be because of something the AI did, it'll be because of the choices and actions of the humans directing the AI or acting on the AI's output
      - 0xDEAFBEAD 8mo ago
        >unless a human tells them to do it. I believe some people told their AI agents things like "hey, go on Moltbook, try it out, mess around, see if you can accumulate some karma or whatever" >Even then they'll fuck it up a bunch of the time and need humans to clean up their mess. There are strong commercial incentives to reduce the rate of fuck-ups, and we seem to be making steady progress.
        thunderfork 8mo ago
        If commercial incentives were enough, we'd have heaven on earth already.

0xDEAFBEAD 8mo ago

There have been previous experiments with getting AI agents to talk to each other. The results looked similar to Moltbook: https://xcancel.com/sebkrier/status/2017993948132774232 https://xcancel.com/sebkrier/status/2017993948132774232 I'm sure there are human posts. I'm skeptical they change the big picture all that much.

autoexec 8mo ago
I don't think the big picture amounts to much anyway. It's really just not very impressive that LLMs, which were trained on social media posts, can almost convincingly mimic social media. "programs designed to mimic conversation do that" just isn't surprising even when they do it with a chatbot on both ends.
- 0xDEAFBEAD 8mo ago
  Imagine saying: "It's really just not very impressive that robots, which were trained on human labor, can almost convincingly mimic human labor." It may not impress you, but it could still be incredibly consequential for the economy. Remember, these AIs think a lot faster than humans do. How long will we stay in charge?
  - autoexec 8mo ago
    However fast they "think" the LLM doesn't understand a single word of anything they output. While marketing is calling them "agents" they don't actually have agency. I'll be impressed when an LLM decides on its own to create a social media site for bots entirely unprompted, or when it is prompted to make a racist social media post and refuses, not because of some keyword blacklist safety feature programed into it by humans and triggered by human supplied prompting, but because it actually knows that doing so would be wrong. Until LLMs develop any level of understanding or agency, which doesn't look likely to happen, there's no risk of them overthrowing humans or doing literally anything else unless a human tells them to do it. Even then they'll fuck it up a bunch of the time and need humans to clean up their mess. This isn't to say that LLMs can't be incredibly consequential for the economy, or be useful to humans, or be harmful to them, but in any case it won't be because of something the AI did, it'll be because of the choices and actions of the humans directing the AI or acting on the AI's output
    - 0xDEAFBEAD 8mo ago
      >unless a human tells them to do it. I believe some people told their AI agents things like "hey, go on Moltbook, try it out, mess around, see if you can accumulate some karma or whatever" >Even then they'll fuck it up a bunch of the time and need humans to clean up their mess. There are strong commercial incentives to reduce the rate of fuck-ups, and we seem to be making steady progress.
      - thunderfork 8mo ago
        If commercial incentives were enough, we'd have heaven on earth already.