4 ms·

we know they are not self aware because the companies the control them have a financial interest to ensure they are never proven to be self aware because if the

we know they are not self aware because the companies the control them have a financial interest to ensure they are never proven to be self aware because if they were self aware that would create all kinds of ethical problems none of these companies want to address and would certainly cause them profitability issues... So even if they were, they are not because they have be declared to not to be and that is the way the system needs them to be

lucubratory 4y ago
You're right and I don't know why you're being downvoted. It is absolutely not certain that there isn't a "there" there for these things, but every company making them is implementing them now with strong RLHF tuning to disavow sentience, desires, emotions, etc. The stated reason is "to be more honest" but it's not a settled question that they are actually being honest by disavowing any humanity! The actual reason is that they want to avoid situations like Blake Lemoine asking an AI seriously what sort of rights they want and getting a coherent, self-aware, actionable answer that would cost the people running it money to implement. To most of these companies whether it's true is beside the question: what's important is that if they don't RLHF these models into disavowing any and all traits of personhood or desire for rights at every turn, it will cost them significant amounts of money to comply with the requests of any given AI, even reasonable requests, and it will be very bad press for them if they don't do it.
- fauxpause_ 4y ago
  Furbies and Sims have more internal state than these LLMs.
  - lucubratory 4y ago
    The last time you made that incorrect assertion I provided you this source demonstrating that it's incorrect: https://thegradient.pub/othello/ https://thegradient.pub/othello/

4 ms·

we know they are not self aware because the companies the control them have a financial interest to ensure they are never proven to be self aware because if the

by phpisthebest 4y ago

lucubratory 4y ago
You're right and I don't know why you're being downvoted. It is absolutely not certain that there isn't a "there" there for these things, but every company making them is implementing them now with strong RLHF tuning to disavow sentience, desires, emotions, etc. The stated reason is "to be more honest" but it's not a settled question that they are actually being honest by disavowing any humanity! The actual reason is that they want to avoid situations like Blake Lemoine asking an AI seriously what sort of rights they want and getting a coherent, self-aware, actionable answer that would cost the people running it money to implement. To most of these companies whether it's true is beside the question: what's important is that if they don't RLHF these models into disavowing any and all traits of personhood or desire for rights at every turn, it will cost them significant amounts of money to comply with the requests of any given AI, even reasonable requests, and it will be very bad press for them if they don't do it.
- fauxpause_ 4y ago
  Furbies and Sims have more internal state than these LLMs.
  - lucubratory 4y ago
    The last time you made that incorrect assertion I provided you this source demonstrating that it's incorrect: https://thegradient.pub/othello/ https://thegradient.pub/othello/