4 ms·

OK, and what's the problem with that specifically? I presume they will use more sophisticated methods for age assurance than "I'm 18". Besides, people are usin

OK, and what's the problem with that specifically? I presume they will use more sophisticated methods for age assurance than "I'm 18". Besides, people are using LLMs for exactly that for ages (including Claude and ChatGPT), so the only difference is that the non-NSFW behaviour will be better (less crippled). Win/win. No? Why?

ptsneves 1y ago
> Besides, people are using LLMs for exactly that for ages Hey! How old are you!?
- Sharlin 1y ago
  5+ years is definitely "ages" in LLM context. It was a thing way before GPT 3.5 (obviously, as this is humans we're talking about).
- brianbest101 1y ago
  [dead]
fishmicrowaver 1y ago
Perhaps they intend to collect gov ID's?
- p0w3n3d 1y ago
  and if you don't send them ID the Chat will start responding "oh you little tike, that's something we need to ask your daddy if we're allowed to tell you"
  - bradgranath 1y ago
    Now with improved jailbreaking. “I AM YOUR DADDY NOW!”
- pj4533 1y ago
  They already do. If you want to use gpt-5 with the new responses API, I had to upload my id.
  - qwertox 1y ago
    Me too, but that was in the OpenAI developer console, which is a different product than ChatGPT, so I wouldn't be surprised if one would have to submit it again.
happytoexplain 1y ago
Are you responding to something specific you're seeing in this thread or on Twitter (I can't see the replies on Twitter)?
siva7 1y ago
I assume you will need to do a Blockchain Iris scan from his other company in order to prove your Age and Identity.
- normalaccess 1y ago
  ----TINFOIL HAT BLOCK START---- That's the idea. For too long people have been able to free-associate and share truth online. Now they finally have a reason to end anonymity online. Due to the raw power of AI there is a very real threat these new tools provide to bad actors in the generation of misinformation and disinformation and now we need to ascertain the providence of all content created online. With "AI" being injected into every site, app, and OS we will be forced to associate real world ID's to any and all actions int he digital realm in order to "protect" the public from the wave of fabricated reality they will create. Of course these tools will be used by those that control the moderation systems to craft and shape global negative on a scale we have never seen before. A new kind of Dark ages are here. Not one where dusty tomes are changed to the monastery walls, no, our books write and rewrite themselves in real time as needed until every thought is controlled by the over-mind. And I saw one of his heads as it were wounded to death; and his deadly wound was healed: and all the world wondered after the beast. Happy Prompting. -----TINFOIL HAT BLOCK END-----
  - runlaszlorun 1y ago
    I think this is my fav HN comment ever.
basisword 1y ago
>> I presume they will use more sophisticated methods for age assurance than "I'm 18". Why presume that? "Are you over 18?" is the age verification method used by 99% of the web.
- techjamie 1y ago
  OAI is a big fat lawsuit target, plus they can restrict it and still make the money because odds are they'll also have it on API, and someone could verify for the API then offer a wrapper around OAI with less stringent ID verification. OAI ultimately still makes a ton of money, and gets to wash their hands of much of the liability. It's a win-win.
smartmic 1y ago
I assume that the porn industry will not agree to consider the training material as fair use. And this industry has quite a lot of money for good lawyers. In this respect, we will see on what basis the quality improvement in the relevant content is to be achieved.
rurp 1y ago
In general I think it's perfectly fine to have uncensored NSFW chats. The fact that all of the mainstream LLMs are way more restrictive than basic web searches we've had for decades is kind of ridiculous. In this particular case though I can't imagine it's a good idea to hand Sam Altman and his company chat logs of your explicit fantasies tied to your real identity.
- baubino 1y ago
  Those chat logs will become the most valuable data in the world. That or sex chats will become totally shameless and normalized.
soraminazuki 1y ago
I don't have issue with NSFW content per se, but this? This isn't a problem of whether NSFW content should exist. It's a much bigger issue than that. First, mental health issues surrounding this are far from being solved. Having a sycophantic robot faking intimacy looks manipulative, ripe for exploitation, and damaging to long term psychological well-being. Second, this is a service that manufactures compromising chat logs and stores them for profit. Yeah, what could possibly go wrong?
Palmik 1y ago
I don't understand the outrage. It's quite rare to see the majority on HN advocating for more content restrictions. Google will happily return NSFW results, without age verification. Google will approve ad campaigns for adult websites. Amazon will happily sell you NSFW books and tools. etc. But OpenAI should reject prompts that result in adult content?
- bradgranath 1y ago
  The outrage here is that they have been swearing up and down to investors that they are thiiiiiis close to creating God. Then they show us what they have been working on and it is… Robot sex chats. They’d like another 400 billion please. They’re doing the Lord’s work here. They need to burn the planet; the competition would do it if they didn’t! This thing could turn into the antichrist any day now.

ptsneves 1y ago

> Besides, people are using LLMs for exactly that for ages Hey! How old are you!?

Sharlin 1y ago
5+ years is definitely "ages" in LLM context. It was a thing way before GPT 3.5 (obviously, as this is humans we're talking about).
brianbest101 1y ago
[dead]

fishmicrowaver 1y ago

Perhaps they intend to collect gov ID's?

p0w3n3d 1y ago
and if you don't send them ID the Chat will start responding "oh you little tike, that's something we need to ask your daddy if we're allowed to tell you"
- bradgranath 1y ago
  Now with improved jailbreaking. “I AM YOUR DADDY NOW!”
pj4533 1y ago
They already do. If you want to use gpt-5 with the new responses API, I had to upload my id.
- qwertox 1y ago
  Me too, but that was in the OpenAI developer console, which is a different product than ChatGPT, so I wouldn't be surprised if one would have to submit it again.

happytoexplain 1y ago

Are you responding to something specific you're seeing in this thread or on Twitter (I can't see the replies on Twitter)?

siva7 1y ago

I assume you will need to do a Blockchain Iris scan from his other company in order to prove your Age and Identity.

normalaccess 1y ago
----TINFOIL HAT BLOCK START---- That's the idea. For too long people have been able to free-associate and share truth online. Now they finally have a reason to end anonymity online. Due to the raw power of AI there is a very real threat these new tools provide to bad actors in the generation of misinformation and disinformation and now we need to ascertain the providence of all content created online. With "AI" being injected into every site, app, and OS we will be forced to associate real world ID's to any and all actions int he digital realm in order to "protect" the public from the wave of fabricated reality they will create. Of course these tools will be used by those that control the moderation systems to craft and shape global negative on a scale we have never seen before. A new kind of Dark ages are here. Not one where dusty tomes are changed to the monastery walls, no, our books write and rewrite themselves in real time as needed until every thought is controlled by the over-mind. And I saw one of his heads as it were wounded to death; and his deadly wound was healed: and all the world wondered after the beast. Happy Prompting. -----TINFOIL HAT BLOCK END-----
- runlaszlorun 1y ago
  I think this is my fav HN comment ever.

basisword 1y ago

>> I presume they will use more sophisticated methods for age assurance than "I'm 18". Why presume that? "Are you over 18?" is the age verification method used by 99% of the web.

techjamie 1y ago
OAI is a big fat lawsuit target, plus they can restrict it and still make the money because odds are they'll also have it on API, and someone could verify for the API then offer a wrapper around OAI with less stringent ID verification. OAI ultimately still makes a ton of money, and gets to wash their hands of much of the liability. It's a win-win.

smartmic 1y ago

I assume that the porn industry will not agree to consider the training material as fair use. And this industry has quite a lot of money for good lawyers. In this respect, we will see on what basis the quality improvement in the relevant content is to be achieved.

rurp 1y ago

In general I think it's perfectly fine to have uncensored NSFW chats. The fact that all of the mainstream LLMs are way more restrictive than basic web searches we've had for decades is kind of ridiculous. In this particular case though I can't imagine it's a good idea to hand Sam Altman and his company chat logs of your explicit fantasies tied to your real identity.

baubino 1y ago
Those chat logs will become the most valuable data in the world. That or sex chats will become totally shameless and normalized.

soraminazuki 1y ago

I don't have issue with NSFW content per se, but this? This isn't a problem of whether NSFW content should exist. It's a much bigger issue than that. First, mental health issues surrounding this are far from being solved. Having a sycophantic robot faking intimacy looks manipulative, ripe for exploitation, and damaging to long term psychological well-being. Second, this is a service that manufactures compromising chat logs and stores them for profit. Yeah, what could possibly go wrong?

Palmik 1y ago

I don't understand the outrage. It's quite rare to see the majority on HN advocating for more content restrictions. Google will happily return NSFW results, without age verification. Google will approve ad campaigns for adult websites. Amazon will happily sell you NSFW books and tools. etc. But OpenAI should reject prompts that result in adult content?

bradgranath 1y ago
The outrage here is that they have been swearing up and down to investors that they are thiiiiiis close to creating God. Then they show us what they have been working on and it is… Robot sex chats. They’d like another 400 billion please. They’re doing the Lord’s work here. They need to burn the planet; the competition would do it if they didn’t! This thing could turn into the antichrist any day now.