4 ms·

Turns out the TOS violation had nothing whatsoever to do with racism, as so many commenters here were overly confident to proclaim, in typical HN style. It's be

Turns out the TOS violation had nothing whatsoever to do with racism, as so many commenters here were overly confident to proclaim, in typical HN style. It's because he'd linked to prohibited content in the wiki: https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Textual-Inversion/_compare/9d7346f7f3faa275305cc4a388a3335a0f53961b...bc9a09829dbc90760c8626c83824e05cfab5cb98 https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki... Here's the issue discussing it: https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/6356 https://github.com/AUTOMATIC1111/stable-diffusion-webui/issu...

sillysaurusx 4y ago
That’s … actually worse that they suspended him and killed access to his projects merely for linking to NSFW diffusion models on a wiki. https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Textual-Inversion/_compare/bc9a09829dbc90760c8626c83824e05cfab5cb98 https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki...
- wokwokwok 4y ago
  Given that it was literally a terms of service violation, and resolution was to remove the content in question (ie. this wasn’t GitHub saying “we were wrong” it was them saying, don’t do that or you’re banned)… it seems difficult to be particularly sympathetic.
  - sillysaurusx 4y ago
    The terms should be changed. A violation of terms that they themselves created isn’t automatically right. It’s unclear it’s even technically right, let alone morally or strategically. This has “kickstarter bans Unstable Diffusion” vibes. Can anyone cite the relevant TOS section? It’d be good to know how far they’re trying to extend the moderation umbrella.
    - voxic11 4y ago
      > We do not allow sexually themed or suggestive content that serves little or no purpose other than to solicit an erotic or shocking response, particularly where that content is amplified by its placement in profiles or other social contexts. This includes: ...Pornographic content https://docs.github.com/en/site-policy/acceptable-use-policies/github-sexually-obscene-content https://docs.github.com/en/site-policy/acceptable-use-polici... Now on the other hand this wasn't actually pornographic content, it was links to pornographic content and their TOS doesn't really make it clear that linking is not allowed.
      - techdragon 4y ago
        Haha they have a lot of spam to cleanup then. A frequent discovery of mine is a new foothill of the mountains of spam text dumped onto GitHub. No idea what half of it is there for since it’s not even connected to a GitHub pages setup most of the time. Usually I’ll find them a few pages back for a code search where the spellchecker has helpfully ignored pluralisation and punctuation and I’m getting lots of generic results but for a long enough string of words to narrow down GitHub to the long tail of noise… Lots of txt and markdown and html and textish formats filled with keywords and phrases, some of which are surprisingly suggestive, arguably outright pornography… Oh and there’s the matter of all the code on GitHub related to adult websites and the pornography that they contain, heaps of web scraping scripts to harvest videos and pictures from “tube websites” … the flip side of the coin as well, the content moderation tools like perceptual hashing tools and ML models for adult content or nudity detection that need to include sample images as part of testing and training data… This feels like an area GitHub really shouldn’t be fucking with with respect to the whole “what counts as acceptable”, it’s one thing to prevent people using GitHub to host a free porn site via GitHub pages, it’s another to start policing the definition of acceptable discourse on the topic of adult content and machine learning models, particularly given that machine learning is a highly technical topic and the state of the art is an evolving field full of deeply technical people. I’m deeply unimpressed by the results from stable diffusion but I do see other people having success with it. For me even the most basic things seem to come out mutated and the same efforts to improve non pornography related human depictions from stable diffusion type models will also be applicable to porn … if the hands on my “18th century porcelain doll of a cowboy“ look like some kind of teratogenic mutant out of a bad hyper realistic cartoon, then the porn version can’t be much better and while rule 34 exists the majority of “pornography consumers” looking to ML model based content probably don’t want that either which leads to a sort of “dual use technology” style stand off between the “pornography” and “non-pornography” uses of the exact same technology. GitHub are walking a thin line here and it’s not going to get easier for them.
meowface 4y ago
This appears to be correct. The racism allegations are likely legitimate* but they don't appear to be involved with the account being taken down. * "WhiteOnly" Rimworld mod that removes all non-whites; "PeacefulProtests" mod "narrated by George Floyd"; "BlackOnly" mod that purportedly just disables technological progression, though this claim appears to be unverified; exclusively black or black-painting artists in data set labeled with "n" + almost no other single-letters in use besides another possible euphemism, which when asked about gave a reply of "no comment"; long-time 4channer and /g/ poster (in recent years /g/ has become increasingly far-right; certainly not all /g/ posters are, but in combination with those other factors it may be relevant)
- huggingrear 4y ago
  >"WhiteOnly" Rimworld mod that removes all non-whites This was in response to an already existing mod which removed all white people, which was deemed totally fine. AUTO1111 also made a all black MOD later, which you mentioned. >"BlacksOnly" mod that purportedly just disables technological progression This is false: https://old.reddit.com/r/StableDiffusion/comments/103vsm2/webuis_new_home/j31r3sr/ https://old.reddit.com/r/StableDiffusion/comments/103vsm2/we... All it did was lock the available skintones. >/g/ has become increasingly far-right Any data to back this up with ? And how can you even know that AUTO1111 is active on /g/ ? It's anonymous.
  - deleted 4y ago
    [deleted]
  - iinnPP 4y ago
    There were also plenty of news outlets that reported racist models that didn't produce proper representation. The n identifier could be used as a way to negate this problem or to provide evidence to the contrary of the dominant narrative of the incredibly powerful. When viewed as a whole, everything seems to be done to provide a counter to power. Which is also a function of truly open AI. When all pink is okay and all purple is not, you have a seriously color-based prejudice on your hands. Anyone arguing to the contrary would be wearing a white outfit going on about power in a different time.
deleted 4y ago
[deleted]

sillysaurusx 4y ago

That’s … actually worse that they suspended him and killed access to his projects merely for linking to NSFW diffusion models on a wiki. https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Textual-Inversion/_compare/bc9a09829dbc90760c8626c83824e05cfab5cb98 https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki...

wokwokwok 4y ago
Given that it was literally a terms of service violation, and resolution was to remove the content in question (ie. this wasn’t GitHub saying “we were wrong” it was them saying, don’t do that or you’re banned)… it seems difficult to be particularly sympathetic.
- sillysaurusx 4y ago
  The terms should be changed. A violation of terms that they themselves created isn’t automatically right. It’s unclear it’s even technically right, let alone morally or strategically. This has “kickstarter bans Unstable Diffusion” vibes. Can anyone cite the relevant TOS section? It’d be good to know how far they’re trying to extend the moderation umbrella.
  - voxic11 4y ago
    > We do not allow sexually themed or suggestive content that serves little or no purpose other than to solicit an erotic or shocking response, particularly where that content is amplified by its placement in profiles or other social contexts. This includes: ...Pornographic content https://docs.github.com/en/site-policy/acceptable-use-policies/github-sexually-obscene-content https://docs.github.com/en/site-policy/acceptable-use-polici... Now on the other hand this wasn't actually pornographic content, it was links to pornographic content and their TOS doesn't really make it clear that linking is not allowed.
    - techdragon 4y ago
      Haha they have a lot of spam to cleanup then. A frequent discovery of mine is a new foothill of the mountains of spam text dumped onto GitHub. No idea what half of it is there for since it’s not even connected to a GitHub pages setup most of the time. Usually I’ll find them a few pages back for a code search where the spellchecker has helpfully ignored pluralisation and punctuation and I’m getting lots of generic results but for a long enough string of words to narrow down GitHub to the long tail of noise… Lots of txt and markdown and html and textish formats filled with keywords and phrases, some of which are surprisingly suggestive, arguably outright pornography… Oh and there’s the matter of all the code on GitHub related to adult websites and the pornography that they contain, heaps of web scraping scripts to harvest videos and pictures from “tube websites” … the flip side of the coin as well, the content moderation tools like perceptual hashing tools and ML models for adult content or nudity detection that need to include sample images as part of testing and training data… This feels like an area GitHub really shouldn’t be fucking with with respect to the whole “what counts as acceptable”, it’s one thing to prevent people using GitHub to host a free porn site via GitHub pages, it’s another to start policing the definition of acceptable discourse on the topic of adult content and machine learning models, particularly given that machine learning is a highly technical topic and the state of the art is an evolving field full of deeply technical people. I’m deeply unimpressed by the results from stable diffusion but I do see other people having success with it. For me even the most basic things seem to come out mutated and the same efforts to improve non pornography related human depictions from stable diffusion type models will also be applicable to porn … if the hands on my “18th century porcelain doll of a cowboy“ look like some kind of teratogenic mutant out of a bad hyper realistic cartoon, then the porn version can’t be much better and while rule 34 exists the majority of “pornography consumers” looking to ML model based content probably don’t want that either which leads to a sort of “dual use technology” style stand off between the “pornography” and “non-pornography” uses of the exact same technology. GitHub are walking a thin line here and it’s not going to get easier for them.

meowface 4y ago

This appears to be correct. The racism allegations are likely legitimate* but they don't appear to be involved with the account being taken down. * "WhiteOnly" Rimworld mod that removes all non-whites; "PeacefulProtests" mod "narrated by George Floyd"; "BlackOnly" mod that purportedly just disables technological progression, though this claim appears to be unverified; exclusively black or black-painting artists in data set labeled with "n" + almost no other single-letters in use besides another possible euphemism, which when asked about gave a reply of "no comment"; long-time 4channer and /g/ poster (in recent years /g/ has become increasingly far-right; certainly not all /g/ posters are, but in combination with those other factors it may be relevant)

huggingrear 4y ago
>"WhiteOnly" Rimworld mod that removes all non-whites This was in response to an already existing mod which removed all white people, which was deemed totally fine. AUTO1111 also made a all black MOD later, which you mentioned. >"BlacksOnly" mod that purportedly just disables technological progression This is false: https://old.reddit.com/r/StableDiffusion/comments/103vsm2/webuis_new_home/j31r3sr/ https://old.reddit.com/r/StableDiffusion/comments/103vsm2/we... All it did was lock the available skintones. >/g/ has become increasingly far-right Any data to back this up with ? And how can you even know that AUTO1111 is active on /g/ ? It's anonymous.
- deleted 4y ago
  [deleted]
- iinnPP 4y ago
  There were also plenty of news outlets that reported racist models that didn't produce proper representation. The n identifier could be used as a way to negate this problem or to provide evidence to the contrary of the dominant narrative of the incredibly powerful. When viewed as a whole, everything seems to be done to provide a counter to power. Which is also a function of truly open AI. When all pink is okay and all purple is not, you have a seriously color-based prejudice on your hands. Anyone arguing to the contrary would be wearing a white outfit going on about power in a different time.

deleted 4y ago

[deleted]