4 ms·

Yeah, the difference between "train on this data" and "these interactions might be collected and aggregated across sessions to be included in a future training

Yeah, the difference between "train on this data" and "these interactions might be collected and aggregated across sessions to be included in a future training dataset" is a difficult one to message to most people in software, let alone consumers without that background. By the time you're done explaining how most data is largely garbage, labeling and curating data is difficult and time-consuming, and updates may make things worse such that a rollback is forced, etc. you're up to several paragraphs of explanation and most people won't read that.

AlexandrB 2y ago
If you're worried that what you're putting into the text box might be used to train the AI, I don't see how any of this matters. There's no transparency (or control) on whether your specific input is being used for training or not, so the only safe assumption is that it will be used.
- simonw 2y ago
  This is what I mean when I talk about the AI trust crisis. Plenty of AI vendors will swear that they don't train on input to their models. People straight up don't believe them.
  - AlexandrB 2y ago
    The economic incentives are too stacked. You see companies like reddit signing contracts to sell their user generated data to AI companies[1]. If OpenAI is willing to pay (probably a large sum) for reddit's data, why would they refrain from exploiting data they're already getting for "free"? This also feels like a rerun of the advertising economy's development and how tracking and data collection became more invasive and more common over time. [1] https://www.reuters.com/markets/deals/openai-strikes-deal-bring-reddit-content-chatgpt-2024-05-16/ https://www.reuters.com/markets/deals/openai-strikes-deal-br...
    - phillipcarter 2y ago
      There's several reasons why this may be: 1. Most of the data might be junk, and so it's just not worth it 2. They want paying customers, paying customers don't want this, so they don't offer it for paying customers 3. It's really, really hard to annotate data effectively at that scale. The reason why Reddit data is being bought is because it's effectively pre-annotated. Most users don't follow up with chat responses to give feedback. But people absolutely provide answers and upvotes on forums.
  - janalsncm 2y ago
    It’s like the popcorn button on a microwave. For it to work properly your microwave needs a humidity sensor. Cheap microwaves don’t, but they still include a popcorn button. As a result, no one trusts the popcorn button, even if it works.
- jerkstate 2y ago
  There’s an opt-out: https://www.groovypost.com/howto/opt-out-your-data-on-chatgpt/ https://www.groovypost.com/howto/opt-out-your-data-on-chatgp... Of course, there’s no real way to know if it’s respected or not.

AlexandrB 2y ago

If you're worried that what you're putting into the text box might be used to train the AI, I don't see how any of this matters. There's no transparency (or control) on whether your specific input is being used for training or not, so the only safe assumption is that it will be used.

simonw 2y ago
This is what I mean when I talk about the AI trust crisis. Plenty of AI vendors will swear that they don't train on input to their models. People straight up don't believe them.
- AlexandrB 2y ago
  The economic incentives are too stacked. You see companies like reddit signing contracts to sell their user generated data to AI companies[1]. If OpenAI is willing to pay (probably a large sum) for reddit's data, why would they refrain from exploiting data they're already getting for "free"? This also feels like a rerun of the advertising economy's development and how tracking and data collection became more invasive and more common over time. [1] https://www.reuters.com/markets/deals/openai-strikes-deal-bring-reddit-content-chatgpt-2024-05-16/ https://www.reuters.com/markets/deals/openai-strikes-deal-br...
  - phillipcarter 2y ago
    There's several reasons why this may be: 1. Most of the data might be junk, and so it's just not worth it 2. They want paying customers, paying customers don't want this, so they don't offer it for paying customers 3. It's really, really hard to annotate data effectively at that scale. The reason why Reddit data is being bought is because it's effectively pre-annotated. Most users don't follow up with chat responses to give feedback. But people absolutely provide answers and upvotes on forums.
- janalsncm 2y ago
  It’s like the popcorn button on a microwave. For it to work properly your microwave needs a humidity sensor. Cheap microwaves don’t, but they still include a popcorn button. As a result, no one trusts the popcorn button, even if it works.
jerkstate 2y ago
There’s an opt-out: https://www.groovypost.com/howto/opt-out-your-data-on-chatgpt/ https://www.groovypost.com/howto/opt-out-your-data-on-chatgp... Of course, there’s no real way to know if it’s respected or not.