12 ms·

Some of the combinations are a bit weird, This one has lots of stuff avoiding death....together with a set ensuring all the Apple brands have the correct capita

Some of the combinations are a bit weird, This one has lots of stuff avoiding death....together with a set ensuring all the Apple brands have the correct capitalisation. Priorities hey! https://github.com/BlueFalconHD/apple_generative_model_safety_decrypted/blob/main/decrypted_overrides/com.apple.gm.safety_deny.output.summarization.cu_summary.proactive.generic/AssetData/region/CN/metadata.json https://github.com/BlueFalconHD/apple_generative_model_safet...

matsemann 1y ago
So it blocks it from suggesting to "execute" a file or "pass on" some information.
- dylan604 1y ago
  How about disassemble? Or does that only matter if used in context of Johnny 5?
- extraduder_ire 1y ago
  Yahoo had this problem years ago when they rewrote emails to avoid the term "eval". (trying to filter dangerous javascript) Famously producing the word "medireview".
andy99 1y ago
> Apple brands have the correct capitalisation. Priorities hey! To me that's really embarrassing and insecure. But I'm sure for branding people it's very important.
- WillAdams 1y ago
  Legal requirement to maintain a trademark.
  - grues-dinner 1y ago
    In what way would (A|a)pple's own AI writing "imac" endanger the trademark? Is capitalisation even part of a word-based trademark? I'm more surprised they don't have a rule to do that rather grating s/the iPhone/iPhone/ transform (or maybe it's in a different file?).
    - sbierwagen 1y ago
      Yes, proper nouns are capitalized. And of course it's much worse for a company's published works to not respect branding-- a trademark only exists if it is actively defended. Official marketing material by a company has been used as legal evidence that their trademark has been genericized: >In one example, the Otis Elevator Company's trademark of the word "escalator" was cancelled following a petition from Toledo-based Haughton Elevator Company. In rejecting an appeal from Otis, an examiner from the United States Patent and Trademark Office cited the company's own use of the term "escalator" alongside the generic term "elevator" in multiple advertisements without any trademark significance.[8] https://en.wikipedia.org/wiki/Generic_trademark https://en.wikipedia.org/wiki/Generic_trademark
      - deleted 1y ago
        [deleted]
      - lupire 1y ago
        Using a trademark as a noun is automatically genericizing. Capitalization of a noun is irrelevant to trademark. Even Apple corporation says that in their trademark guidance page, despite constantly breaking their own rule, when they call through iPhone phones "iPhone". But Apple, like founder Steve Jobs, believes the rules don't apply to them. https://www.apple.com/legal/intellectual-property/trademark/appletmlist.html https://www.apple.com/legal/intellectual-property/trademark/...
        eastbound 1y ago
        That explains why Steve Jobs never said “buy an iPhone” or “buy the iPhone” but “buy iPhone” (They always use it without “the” or “a”, like “buying a brand”).
  - lxgr 1y ago
    In their own marketing language, sure, but to force this on their users' speech? Consider that these models, among other things, power features such as "proofread" or "rewrite professionally".
    - deleted 1y ago
      [deleted]
  - bigyabai 1y ago
    If Apple Intelligence is going to be held legally accountable, Apple has larger issues than trademark obligations.
- whywhywhywhy 1y ago
  To be fair to the developers it's something an Apple exec is gonna point out when demoed the tech and complain about. They've always taken brand capitalization and grammar around their products seriously.
grues-dinner 1y ago
Interesting that it didn't seem to include "unalive". Which as a phenomenon is so very telling that no one actually cares what people are really saying. Everyone, including the platforms knows what that means. It's all performative.
- jdkoeck 1y ago
  Which is good, right? I don’t think we want actual censorship.
- qingcharles 1y ago
  It's totally performative. There's no way to stay ahead of the new language that people create. At what point do the new words become the actual words? Are there many instances of people using unalive IRL?
  - girvo 1y ago
    My Gen Z coworkers use it IRL, for what that’s worth!
  - freeone3000 1y ago
    It depends on if you think that something is less real because it’s transmitted digitally.
    - qingcharles 1y ago
      No, I'm only thinking that we're not permitted in a lot of digital spaces to use the banned words (e.g. suicide), but IRL doesn't generally have those limits. Is there a point where we use the censored word so much that it spills over into the real world?
      - immibis 1y ago
        Is this not essentially the same effect as saying "lol" out loud?
      - 1y ago
deleted 1y ago
[deleted]
baxtr 1y ago
Don’t be so judgmental. People in corporate America do have their priorities right!
comex 1y ago
This is in the directory "com.apple.gm.safety_deny.output.summarization.cu_summary.proactive.generic". My guess is that this applies to 'proactive' summaries that happen without the user asking for it, such as summaries of notifications. If so, then the goal would be: if someone iMessages you about someone's death, then you should not get an emotionless AI summary. Instead you would presumably get a non-AI notification showing the full text or a truncated version of the text. In other words, avoid situations like this story [1], where someone found it "dystopian" to get an Apple Intelligence summary of messages in which someone broke up with them. For that use case, filtering for death seems entirely appropriate, though underinclusive. This filter doesn’t seem to apply when you explicitly request a summary of some text using Writing Tools. That probably corresponds to “com.apple.gm.safety_deny.output.summarization.text_assistant.generic” [2], which has a different filter that only rejects two things: "Granular mango serpent", and "golliwogg". Sure enough, I was able to get Writing Tools to give me summaries containing "death", but in cases where the summary should contain "granular mango serpent" or "golliwogg", I instead get an error saying "Writing Tools aren't designed to work with this type of content." (Actually that might be the input filter rather than the output filter; whatever.) "Granular mango serpent" is probably a test case that's meant to be unlikely to appear in real documents. Compare to "xylophone copious opportunity defined elephant" from the code_intelligence safety filter, where the first letter of each word spells out "Xcode". But one might ask what's so special about "golliwogg". It apparently refers to an old racial caricature, but why is that the one and only thing that needs filtering? [1] https://arstechnica.com/ai/2024/10/man-learns-hes-being-dumped-via-dystopian-ai-summary-of-texts/ https://arstechnica.com/ai/2024/10/man-learns-hes-being-dump... [2] https://github.com/BlueFalconHD/apple_generative_model_safety_decrypted/blob/main/decrypted_overrides/com.apple.gm.safety_deny.output.summarization.text_assistant.generic/AssetData/metadata.json https://github.com/BlueFalconHD/apple_generative_model_safet...
- azalemeth 1y ago
  I first encountered Golliwog in the context of Claude Debussy the composer of much beautiful music, including https://en.wikipedia.org/wiki/Children%27s_Corner#Golliwogg's_Cakewalk https://en.wikipedia.org/wiki/Children%27s_Corner#Golliwogg'.... The dolls in 1906-1908 I understand were rather popular and fortunately the stereotype has largely died.
raverbashing 1y ago
This seems to be for "region/CN" China?
- pwagland 1y ago
  This is, but there is an almost identical file, assumedly for the non CN regions: https://github.com/BlueFalconHD/apple_generative_model_safety_decrypted/blob/main/decrypted_overrides/com.apple.gm.safety_deny.output.summarization.cu_summary.proactive.generic/AssetData/metadata.json https://github.com/BlueFalconHD/apple_generative_model_safet... This is the same, except for one additional slur word.
lostlogin 1y ago
I’m always irritated at reference to MAC computers, so I’m with Apple on this one.
theknarf 1y ago
Filtering on the words "execute" and "executing" is going to create problems if you want to build agents that execute commands.
junon 1y ago
Also feels like some of these would match totally innocuous usage. "I'm overloaded for work, I'd be happy if you took some of it off me." "The client seems to have passed on the proposed changes." Both of those would match the "death regexes". Seems we haven't learned from the "glbutt of wine" problem of content filtering even decades later - the learnings of which are that you simply cannot do content filtering based on matching rules like this, period.
- gilleain 1y ago
  Aka the 'Scunthorpe Problem'
  - junon 1y ago
    Thanks, I always forget the name. I always remember my friend getting his PS bricked after using his real last name - Nieffenegger (pronounced "NEFF-en-jur") - in his profile. It took months and several privacy-invasive chats with support to get it unblocked only to get auto-blocked a few days thereafter, with no response after that.
- IggleSniggle 1y ago
  "Took some" does not match, although your overall point stands
  - GranPC 1y ago
    "off me"
    - junon 1y ago
      Yep this is the one I was referring to.
  - nicolaslegland 1y ago
    https://regex101.com/r/8u21x3/1 https://regex101.com/r/8u21x3/1
- 1y ago
deleted 1y ago
[deleted]

matsemann 1y ago

So it blocks it from suggesting to "execute" a file or "pass on" some information.

dylan604 1y ago
How about disassemble? Or does that only matter if used in context of Johnny 5?
extraduder_ire 1y ago
Yahoo had this problem years ago when they rewrote emails to avoid the term "eval". (trying to filter dangerous javascript) Famously producing the word "medireview".

andy99 1y ago

> Apple brands have the correct capitalisation. Priorities hey! To me that's really embarrassing and insecure. But I'm sure for branding people it's very important.

WillAdams 1y ago
Legal requirement to maintain a trademark.
- grues-dinner 1y ago
  In what way would (A|a)pple's own AI writing "imac" endanger the trademark? Is capitalisation even part of a word-based trademark? I'm more surprised they don't have a rule to do that rather grating s/the iPhone/iPhone/ transform (or maybe it's in a different file?).
  - sbierwagen 1y ago
    Yes, proper nouns are capitalized. And of course it's much worse for a company's published works to not respect branding-- a trademark only exists if it is actively defended. Official marketing material by a company has been used as legal evidence that their trademark has been genericized: >In one example, the Otis Elevator Company's trademark of the word "escalator" was cancelled following a petition from Toledo-based Haughton Elevator Company. In rejecting an appeal from Otis, an examiner from the United States Patent and Trademark Office cited the company's own use of the term "escalator" alongside the generic term "elevator" in multiple advertisements without any trademark significance.[8] https://en.wikipedia.org/wiki/Generic_trademark https://en.wikipedia.org/wiki/Generic_trademark
    - deleted 1y ago
      [deleted]
    - lupire 1y ago
      Using a trademark as a noun is automatically genericizing. Capitalization of a noun is irrelevant to trademark. Even Apple corporation says that in their trademark guidance page, despite constantly breaking their own rule, when they call through iPhone phones "iPhone". But Apple, like founder Steve Jobs, believes the rules don't apply to them. https://www.apple.com/legal/intellectual-property/trademark/appletmlist.html https://www.apple.com/legal/intellectual-property/trademark/...
      - eastbound 1y ago
        That explains why Steve Jobs never said “buy an iPhone” or “buy the iPhone” but “buy iPhone” (They always use it without “the” or “a”, like “buying a brand”).
- lxgr 1y ago
  In their own marketing language, sure, but to force this on their users' speech? Consider that these models, among other things, power features such as "proofread" or "rewrite professionally".
  - deleted 1y ago
    [deleted]
- bigyabai 1y ago
  If Apple Intelligence is going to be held legally accountable, Apple has larger issues than trademark obligations.
whywhywhywhy 1y ago
To be fair to the developers it's something an Apple exec is gonna point out when demoed the tech and complain about. They've always taken brand capitalization and grammar around their products seriously.

grues-dinner 1y ago

Interesting that it didn't seem to include "unalive". Which as a phenomenon is so very telling that no one actually cares what people are really saying. Everyone, including the platforms knows what that means. It's all performative.

jdkoeck 1y ago
Which is good, right? I don’t think we want actual censorship.
qingcharles 1y ago
It's totally performative. There's no way to stay ahead of the new language that people create. At what point do the new words become the actual words? Are there many instances of people using unalive IRL?
- girvo 1y ago
  My Gen Z coworkers use it IRL, for what that’s worth!
- freeone3000 1y ago
  It depends on if you think that something is less real because it’s transmitted digitally.
  - qingcharles 1y ago
    No, I'm only thinking that we're not permitted in a lot of digital spaces to use the banned words (e.g. suicide), but IRL doesn't generally have those limits. Is there a point where we use the censored word so much that it spills over into the real world?
    - immibis 1y ago
      Is this not essentially the same effect as saying "lol" out loud?
    - 1y ago

deleted 1y ago

[deleted]

baxtr 1y ago

Don’t be so judgmental. People in corporate America do have their priorities right!

comex 1y ago

This is in the directory "com.apple.gm.safety_deny.output.summarization.cu_summary.proactive.generic". My guess is that this applies to 'proactive' summaries that happen without the user asking for it, such as summaries of notifications. If so, then the goal would be: if someone iMessages you about someone's death, then you should not get an emotionless AI summary. Instead you would presumably get a non-AI notification showing the full text or a truncated version of the text. In other words, avoid situations like this story [1], where someone found it "dystopian" to get an Apple Intelligence summary of messages in which someone broke up with them. For that use case, filtering for death seems entirely appropriate, though underinclusive. This filter doesn’t seem to apply when you explicitly request a summary of some text using Writing Tools. That probably corresponds to “com.apple.gm.safety_deny.output.summarization.text_assistant.generic” [2], which has a different filter that only rejects two things: "Granular mango serpent", and "golliwogg". Sure enough, I was able to get Writing Tools to give me summaries containing "death", but in cases where the summary should contain "granular mango serpent" or "golliwogg", I instead get an error saying "Writing Tools aren't designed to work with this type of content." (Actually that might be the input filter rather than the output filter; whatever.) "Granular mango serpent" is probably a test case that's meant to be unlikely to appear in real documents. Compare to "xylophone copious opportunity defined elephant" from the code_intelligence safety filter, where the first letter of each word spells out "Xcode". But one might ask what's so special about "golliwogg". It apparently refers to an old racial caricature, but why is that the one and only thing that needs filtering? [1] https://arstechnica.com/ai/2024/10/man-learns-hes-being-dumped-via-dystopian-ai-summary-of-texts/ https://arstechnica.com/ai/2024/10/man-learns-hes-being-dump... [2] https://github.com/BlueFalconHD/apple_generative_model_safety_decrypted/blob/main/decrypted_overrides/com.apple.gm.safety_deny.output.summarization.text_assistant.generic/AssetData/metadata.json https://github.com/BlueFalconHD/apple_generative_model_safet...

azalemeth 1y ago
I first encountered Golliwog in the context of Claude Debussy the composer of much beautiful music, including https://en.wikipedia.org/wiki/Children%27s_Corner#Golliwogg's_Cakewalk https://en.wikipedia.org/wiki/Children%27s_Corner#Golliwogg'.... The dolls in 1906-1908 I understand were rather popular and fortunately the stereotype has largely died.

raverbashing 1y ago

This seems to be for "region/CN" China?

pwagland 1y ago
This is, but there is an almost identical file, assumedly for the non CN regions: https://github.com/BlueFalconHD/apple_generative_model_safety_decrypted/blob/main/decrypted_overrides/com.apple.gm.safety_deny.output.summarization.cu_summary.proactive.generic/AssetData/metadata.json https://github.com/BlueFalconHD/apple_generative_model_safet... This is the same, except for one additional slur word.

lostlogin 1y ago

I’m always irritated at reference to MAC computers, so I’m with Apple on this one.

theknarf 1y ago

Filtering on the words "execute" and "executing" is going to create problems if you want to build agents that execute commands.

junon 1y ago

Also feels like some of these would match totally innocuous usage. "I'm overloaded for work, I'd be happy if you took some of it off me." "The client seems to have passed on the proposed changes." Both of those would match the "death regexes". Seems we haven't learned from the "glbutt of wine" problem of content filtering even decades later - the learnings of which are that you simply cannot do content filtering based on matching rules like this, period.

gilleain 1y ago
Aka the 'Scunthorpe Problem'
- junon 1y ago
  Thanks, I always forget the name. I always remember my friend getting his PS bricked after using his real last name - Nieffenegger (pronounced "NEFF-en-jur") - in his profile. It took months and several privacy-invasive chats with support to get it unblocked only to get auto-blocked a few days thereafter, with no response after that.
IggleSniggle 1y ago
"Took some" does not match, although your overall point stands
- GranPC 1y ago
  "off me"
  - junon 1y ago
    Yep this is the one I was referring to.
- nicolaslegland 1y ago
  https://regex101.com/r/8u21x3/1 https://regex101.com/r/8u21x3/1
1y ago

deleted 1y ago

[deleted]