3 ms·

> The key message I'm trying to convey in this piece is that models don't instantly remember what you tell them. Are you sure? We have no idea how OpenAI runs

• simonw 2y ago
  That's a good point: I didn't consider that they might have additional non-transformer models running in the ChatGPT layer that aren't exposed via their API models. I think that's quite unlikely, given the recent launch of their "memory" feature which wouldn't be necessary if they had a more sophisticated mechanism for achieving the same thing. As always, the total lack of transparency really hurts them here.
  • Matticus_Rex 2y ago
    An element in the layer collecting data for training future models would almost certainly not be able to fulfill the same function as the memory feature.
  • glandium 2y ago
    They could very well have an "agent" that scrapes all conversations and tags elements that it finds might be interesting to feed the training of a future model. At least, that's what I would do if I were in their shoes. They presumably have a moderator agent that runs separately of ChatGPT and that causes the "This content may violate our content policy" orange box via `type: moderation` messages. They could just as well have a number of other agents.
• ClassyJacket 2y ago
  People are using and picking apart and blogging about their services so much that I feel like if they were doing something like this we would know about it in some sense, even if we didn't know how they were doing it