20 ms·
Maybe I'm misinterpreting, but the article seems (?) to be implying there's something scandalous about OpenAI training an adult websites. I find that odd. Woul
by Wowfunhappy 1y ago
Maybe I'm misinterpreting, but the article seems (?) to be implying there's something scandalous about OpenAI training an adult websites.
I find that odd. Would anyone be surprised to know that Google indexes adult websites, and ranks them in its search algorithm? If not, what is the difference for an LLM?
- refulgentis 1y agoFWIW, I didn't get that sense.
- raincole 1y agoAnd it's nothing new. https://github.com/jiangyy/gpt-tokens https://github.com/jiangyy/gpt-tokens People found these adult-site-related Chinese phrases in Gpt-4o. The OP is more than one year late.
- pydry 1y agoTheyre saying if you find references to a very specific set of phrases that were probably included accidentally on github then github is likely part of the training data.
- relatedtitle 1y agoGitHub is obviously part of the training data, you don't need to find obscure tokens to tell.
- mudkipdev 1y agoWouldn't it be best for them to strip that out of the training data for moderation reasons?