3 ms·

Are you sure it's fully deobfuscated? What's up with reject phrases like "Granular mango serpent"?

by mike_hearn 1y ago

tablets 1y ago
Maybe something to do with this? https://en.m.wikipedia.org/wiki/Mango_cult https://en.m.wikipedia.org/wiki/Mango_cult
airstrike 1y ago
the one at the bottom of the README spells out xcode wyvern illustrous laments darkness
- cwmoore 1y ago
  read every good expletive “xxx”
andy99 1y ago
I clicked around a bit and this seems to be the most common phrase. Maybe it's a test phrase?
- the-rc 1y ago
  Maybe it's used to catch clones of the models?
electroly 1y ago
"GMS" = Generative Model Safety. The example from the readme is "XCODE". These seem to be acronyms spelled out in words.
- BlueFalconHD 1y ago
  This is definitely the right answer. It’s just testing stuff.
pbhjpbhj 1y ago
Speculation: Maybe they know that the real phrase is close enough in the vector space to be treated as synonymous with "granular mango serpent". The phrase then is like a nickname that only the models authors know the expected interference of? Thus a pre-prompt can avoid mentioning the actual forbidden words, like using a patois/cant.
BlueFalconHD 1y ago
These are the contents read by the Obfuscation functions exactly. There seems to be a lot of testing stuff still though, remember these models are relatively recent. There is a true safety model being applied after these checks as well, this is just to catch things before needing to load the safety model.
KTibow 1y ago
Maybe it's used to verify that the filter is loaded.
RainyDayTmrw 1y ago
I commented in another thread[1] that it's most likely a unique, artificial QA input, to avoid QA having to repeatedly use offensive phrases or whatever. [1] https://news.ycombinator.com/item?id=44486374 https://news.ycombinator.com/item?id=44486374
consonaut 1y ago
If you try to use the phrase with Apple Intelligence (e.g. in Notes asking for a rewrite) it will just say "Writing tools unavailable". Maybe it's an easy test to ensure the filters are loaded with a phrase unlikely to be used accidentaly?

Are you sure it's fully deobfuscated? What's up with reject phrases like "Granular mango serpent"?

tablets 1y ago

Maybe something to do with this? https://en.m.wikipedia.org/wiki/Mango_cult https://en.m.wikipedia.org/wiki/Mango_cult

airstrike 1y ago

the one at the bottom of the README spells out xcode wyvern illustrous laments darkness

cwmoore 1y ago
read every good expletive “xxx”

andy99 1y ago

I clicked around a bit and this seems to be the most common phrase. Maybe it's a test phrase?

the-rc 1y ago
Maybe it's used to catch clones of the models?

electroly 1y ago

"GMS" = Generative Model Safety. The example from the readme is "XCODE". These seem to be acronyms spelled out in words.

BlueFalconHD 1y ago
This is definitely the right answer. It’s just testing stuff.

pbhjpbhj 1y ago

Speculation: Maybe they know that the real phrase is close enough in the vector space to be treated as synonymous with "granular mango serpent". The phrase then is like a nickname that only the models authors know the expected interference of? Thus a pre-prompt can avoid mentioning the actual forbidden words, like using a patois/cant.

BlueFalconHD 1y ago

These are the contents read by the Obfuscation functions exactly. There seems to be a lot of testing stuff still though, remember these models are relatively recent. There is a true safety model being applied after these checks as well, this is just to catch things before needing to load the safety model.

KTibow 1y ago

Maybe it's used to verify that the filter is loaded.

RainyDayTmrw 1y ago

I commented in another thread[1] that it's most likely a unique, artificial QA input, to avoid QA having to repeatedly use offensive phrases or whatever. [1] https://news.ycombinator.com/item?id=44486374 https://news.ycombinator.com/item?id=44486374

consonaut 1y ago

If you try to use the phrase with Apple Intelligence (e.g. in Notes asking for a rewrite) it will just say "Writing tools unavailable". Maybe it's an easy test to ensure the filters are loaded with a phrase unlikely to be used accidentaly?