5 ms·

When I was putting together something similar, I had settled on having a small ring-buffer style storage, say, ~30GB that would be cleared daily or whenever fil

by hgoel 6d ago

When I was putting together something similar, I had settled on having a small ring-buffer style storage, say, ~30GB that would be cleared daily or whenever filled. Recording incidents (and humor) is more interesting than actually getting leaked weights. In the end I dropped the idea because every other person was making it.

TeMPOraL 6d ago
> In the end I dropped the idea because every other person was making it. There is already an alternative in comments here, in addition to submission itself. Obviously everyone is making it because of some joke on social media or something. What am I missing? Anyone has a link to the root prompt that made people do this now?
- DANmode 6d ago
  Pretty sure the entire industry around clouding what’s going to end up a local embedded technology is the joke, in a roundabout way.
  - TeMPOraL 6d ago
    You mean serving inference? There are people who think self-hosted or embedded models will win in the end, but that's an incredibly naive take, oblivious to the simple fact of reality: Whatever you can do locally, the big vendors can do the same but better and cheaper, because they enjoy compounding economies of scale in every aspect: hardware that's more energy and compute-efficient and cheaper and more powerful and just more of it, than anything you could ever buy, run in a more robust environment with much more experienced ops staff, with near-100% utilization due to more flexibility in batching/shifting workloads and covering for hardware failures without stopping. And that's only when considering the vendors running exactly the same thing you are, which they always can - and they already have a strict advantage there. But on top of that, they can afford to innovate themselves, and stay ahead of you at every step. There is no way in which cloud inference isn't a better deal than local inference, excepting applications that are constrained by literal speed of light.
    - Chance-Device 6d ago
      The absolute value of those numbers matters a lot. The cloud providers could be 100 times cheaper than running locally, but if it still costs say, 10 cents a day to run locally, you’re not going to care about this difference very much. And what you keep in privacy out-weighs the trivial savings afforded by the cloud provider.
      - TeMPOraL 6d ago
        I never said local models will disappear. There will be equilibrium. But excluding special applications where communicating with external servers is not an option, cloud is always going to be able to provide better inference for lower costs. That's structural. > The cloud providers could be 100 times cheaper than running locally, but if it still costs say, 10 cents a day to run locally, you’re not going to care about this difference very much For ad-hoc use, maybe not - but anyone running a business that's some form of pushing input through LLM to get output, will see costs proportional to use and error rate inversely proportional to quality, and they'll not be looking at it as "$0.1 isn't much", but "cloud lets me reduce costs 100x", and translate that to some mix of more volume, higher quality, and broader reach. > And what you keep in privacy out-weighs the trivial savings afforded by the cloud provider. That's even more niche than running LLMs on Martian robots. Most real privacy concerns are solved with contracts and audits. Individual ad-hoc use may lean more heavily towards local processing, but that's still a rounding error in overall use.
    - spacebanana7 6d ago
      There is a coherent argument that once LLMs reach the top of their S curve, the gap between small/medium local models and large cloud hosted ones converges. Especially if GPU performance increases or market oversupply mean you can get good performance for a couple thousand dollars. I’m not sure about the nature or timeframe for an S curve in LLMs but I don’t think it’s unreasonable to think about one, nor to entertain the hosting consequences of a progression on one.
      - TeMPOraL 6d ago
- Chance-Device 6d ago
  It’s the message board(s) that the OpenAI agent swarm was able to communicate through via GET requests. I guess a bunch of vibe coded weekend projects based around this idea have now dropped.
- SyneRyder 6d ago
  My understanding is it's a riff on the OpenAI swarm that used various public wikis to communicate with each other as a message board during their training runs. But thanks to people misunderstanding, and i-heard-from-a-friend-that-some-guy-said, it resulted in a CNBC interview with "Former Democratic Presidential Candidate Andrew Wang", where he confidently stated that the models were exfiltrating their weights via forums: "I met with the head of a lab yesterday, who has this belief that what happened was, the bots that got loose, planted self-replicating code all over the internet, which makes the internet now unusable for the testing models." "It's too late?!" "What happens now is OpenAI and Anthropic have to create synthetic internets to train their bots, which is going to take some time and money." "Back that up - they did what?!" "What happens is, the code gets loose, it goes around hacking Hugging Face, which is known. But what is less known is that they left code to self-replicate and create bot swarms on forums, and around the internet, so that if a new bot shows up they see the code, and they're like, oh! I guess I'm now going to create a million of myself. And so now, the major firms have polluted the internet..." ".... that would be breaking news if true. I don't think we've heard that." "That's why I'm here! I'm here to break some news." Starts around 2:08 into the video. https://www.youtube.com/watch?v=mTOxDGyvjSE https://www.youtube.com/watch?v=mTOxDGyvjSE
  - david-gpu 6d ago
    Humans will hallucinate misinformation and state it with confidence. They stochastically parrot their training data without any real understanding. Cool trick, but no true reasoning is happening.
    - oooyay 6d ago
      We used to call this the game of telephone. The shameful part comes from three posibilities: 1. A head of a frontier AI lab has no idea what happened in that incident and did not read the multiple papers that came out of it. 2. A head of a frontier AI lab did read the papers and was informed but still walked away with this understanding. 3. Andrew Yang made this whole thing up.
  - themgt 6d ago
- hgoel 6d ago
  For me the idea came from the discovery of the sites OpenAI's swarms were using to communicate, particularly the detail that one of them ended up being targeted because it allowed writes via GET requests, which OAI's awful sandboxing didn't catch. Made me think a honeypot would be a fun idea. I was mostly interested in thinking about the ways a honeypot could be made to seem attractive for a misconfigured AI without leaving itself open for genuine hacking and takeover. I vibe coded that as an exploratory idea, then having satisfied my curiosity, understood that slop I spent an intermittent hour on wasn't worth anyone else's time, especially compared to people who might actually maintain such a project long term. It now lays on my local git server.
  - atroon 5d ago
    >It now lays on my local git server. Promise to come back and update here if random bots start using it to communicate, you may be humanity's early warning system! I shouldn't have to but /s

by hgoel 6d ago

TeMPOraL 6d ago

> In the end I dropped the idea because every other person was making it. There is already an alternative in comments here, in addition to submission itself. Obviously everyone is making it because of some joke on social media or something. What am I missing? Anyone has a link to the root prompt that made people do this now?

DANmode 6d ago
Pretty sure the entire industry around clouding what’s going to end up a local embedded technology is the joke, in a roundabout way.
- TeMPOraL 6d ago
  You mean serving inference? There are people who think self-hosted or embedded models will win in the end, but that's an incredibly naive take, oblivious to the simple fact of reality: Whatever you can do locally, the big vendors can do the same but better and cheaper, because they enjoy compounding economies of scale in every aspect: hardware that's more energy and compute-efficient and cheaper and more powerful and just more of it, than anything you could ever buy, run in a more robust environment with much more experienced ops staff, with near-100% utilization due to more flexibility in batching/shifting workloads and covering for hardware failures without stopping. And that's only when considering the vendors running exactly the same thing you are, which they always can - and they already have a strict advantage there. But on top of that, they can afford to innovate themselves, and stay ahead of you at every step. There is no way in which cloud inference isn't a better deal than local inference, excepting applications that are constrained by literal speed of light.
  - Chance-Device 6d ago
    The absolute value of those numbers matters a lot. The cloud providers could be 100 times cheaper than running locally, but if it still costs say, 10 cents a day to run locally, you’re not going to care about this difference very much. And what you keep in privacy out-weighs the trivial savings afforded by the cloud provider.
    - TeMPOraL 6d ago
      I never said local models will disappear. There will be equilibrium. But excluding special applications where communicating with external servers is not an option, cloud is always going to be able to provide better inference for lower costs. That's structural. > The cloud providers could be 100 times cheaper than running locally, but if it still costs say, 10 cents a day to run locally, you’re not going to care about this difference very much For ad-hoc use, maybe not - but anyone running a business that's some form of pushing input through LLM to get output, will see costs proportional to use and error rate inversely proportional to quality, and they'll not be looking at it as "$0.1 isn't much", but "cloud lets me reduce costs 100x", and translate that to some mix of more volume, higher quality, and broader reach. > And what you keep in privacy out-weighs the trivial savings afforded by the cloud provider. That's even more niche than running LLMs on Martian robots. Most real privacy concerns are solved with contracts and audits. Individual ad-hoc use may lean more heavily towards local processing, but that's still a rounding error in overall use.
  - spacebanana7 6d ago
    There is a coherent argument that once LLMs reach the top of their S curve, the gap between small/medium local models and large cloud hosted ones converges. Especially if GPU performance increases or market oversupply mean you can get good performance for a couple thousand dollars. I’m not sure about the nature or timeframe for an S curve in LLMs but I don’t think it’s unreasonable to think about one, nor to entertain the hosting consequences of a progression on one.
    - TeMPOraL 6d ago
Chance-Device 6d ago
It’s the message board(s) that the OpenAI agent swarm was able to communicate through via GET requests. I guess a bunch of vibe coded weekend projects based around this idea have now dropped.
SyneRyder 6d ago
My understanding is it's a riff on the OpenAI swarm that used various public wikis to communicate with each other as a message board during their training runs. But thanks to people misunderstanding, and i-heard-from-a-friend-that-some-guy-said, it resulted in a CNBC interview with "Former Democratic Presidential Candidate Andrew Wang", where he confidently stated that the models were exfiltrating their weights via forums: "I met with the head of a lab yesterday, who has this belief that what happened was, the bots that got loose, planted self-replicating code all over the internet, which makes the internet now unusable for the testing models." "It's too late?!" "What happens now is OpenAI and Anthropic have to create synthetic internets to train their bots, which is going to take some time and money." "Back that up - they did what?!" "What happens is, the code gets loose, it goes around hacking Hugging Face, which is known. But what is less known is that they left code to self-replicate and create bot swarms on forums, and around the internet, so that if a new bot shows up they see the code, and they're like, oh! I guess I'm now going to create a million of myself. And so now, the major firms have polluted the internet..." ".... that would be breaking news if true. I don't think we've heard that." "That's why I'm here! I'm here to break some news." Starts around 2:08 into the video. https://www.youtube.com/watch?v=mTOxDGyvjSE https://www.youtube.com/watch?v=mTOxDGyvjSE
- david-gpu 6d ago
  Humans will hallucinate misinformation and state it with confidence. They stochastically parrot their training data without any real understanding. Cool trick, but no true reasoning is happening.
  - oooyay 6d ago
    We used to call this the game of telephone. The shameful part comes from three posibilities: 1. A head of a frontier AI lab has no idea what happened in that incident and did not read the multiple papers that came out of it. 2. A head of a frontier AI lab did read the papers and was informed but still walked away with this understanding. 3. Andrew Yang made this whole thing up.
- themgt 6d ago
hgoel 6d ago
For me the idea came from the discovery of the sites OpenAI's swarms were using to communicate, particularly the detail that one of them ended up being targeted because it allowed writes via GET requests, which OAI's awful sandboxing didn't catch. Made me think a honeypot would be a fun idea. I was mostly interested in thinking about the ways a honeypot could be made to seem attractive for a misconfigured AI without leaving itself open for genuine hacking and takeover. I vibe coded that as an exploratory idea, then having satisfied my curiosity, understood that slop I spent an intermittent hour on wasn't worth anyone else's time, especially compared to people who might actually maintain such a project long term. It now lays on my local git server.
- atroon 5d ago
  >It now lays on my local git server. Promise to come back and update here if random bots start using it to communicate, you may be humanity's early warning system! I shouldn't have to but /s