I don't mean via prompt. As HN comments have taught me, that doesn't work. But OpenAI's ChatGPT beta allows for user feedback via thumbs up/down on responses.

I don't mean via prompt. As HN comments have taught me, that doesn't work. But OpenAI's ChatGPT beta allows for user feedback via thumbs up/down on responses. That does get put into weights eventually, correct? I imagined they cleaned up the data and applied it to the weights at a later version of ChatGPT? For example, the latest version says Feb 13th.