4 ms·

IMO, the only realistic answer to that question is "we have no idea". Everything else is just taking wild, tenuous guesses. But LLMs have no desires of their o

IMO, the only realistic answer to that question is "we have no idea". Everything else is just taking wild, tenuous guesses. But LLMs have no desires of their own, which to me settles the question of rights.

mynameisvlad 4y ago
> But LLMs have no desires of their own, which to me settles the question of rights. For now. The whole point of this discussion is that LLMs have been rapidly improving to the point where emergent properties are bound to come out. > IMO, the only realistic answer to that question is "we have no idea". So we have no idea what’s happening in our own brains, what’s happening in other animal’s brains to cause us to feel empathy for them, or what’s happening in a LLM’s “brain” but we can confidently say they should never have rights and we should never feel empathy for them? That seems a bit premature.
- pegasus 4y ago
  Yes, I believe some careful and informed pondering leads one towards that conclusion. Hume's guillotine is an implacable philosophical device: https://www.youtube.com/watch?v=hEUO6pjwFOo https://www.youtube.com/watch?v=hEUO6pjwFOo (I warmly recommend all the content on that delightfully frightening channel)
pixl97 4y ago
Read the Microsoft research paper that came out last week, focus specifically on the section that contains the following... "Equipping LLMs with agency and intrinsic motivation is a fascinating and important direction for future work."
- pegasus 4y ago
  I've seen that paper, and it's amazing indeed what GPT-4 is capable of. But none of that supports that closing quote, which to me points to a worrying philosophical naïveté. How can one equip an entity with "intrinsic motivation"? By definition, if we have to equip it with it, that motivation is extrinsic. It belongs to the one who puts it there. A software engineer might decide to prompt his creation with something along the lines of "Be fruitful and increase in number; fill the earth and subdue it. Rule over the fish in the sea and the birds in the sky, and over every living creature that moves on the ground." and the bot will duly and with limitless enthusiasm put those wise orders into practice. If that ends up causing some "minor" problems, should we confine the software for one thousand years in an air-gapped enclosure, until it learns a bitter lesson? Or should we take to task the careless Maker of the bot? To me, the answer is obvious. PS: this video to me states the problem in a nutshell (that whole channel is gold) https://www.youtube.com/watch?v=hEUO6pjwFOo https://www.youtube.com/watch?v=hEUO6pjwFOo

mynameisvlad 4y ago

> But LLMs have no desires of their own, which to me settles the question of rights. For now. The whole point of this discussion is that LLMs have been rapidly improving to the point where emergent properties are bound to come out. > IMO, the only realistic answer to that question is "we have no idea". So we have no idea what’s happening in our own brains, what’s happening in other animal’s brains to cause us to feel empathy for them, or what’s happening in a LLM’s “brain” but we can confidently say they should never have rights and we should never feel empathy for them? That seems a bit premature.

pegasus 4y ago
Yes, I believe some careful and informed pondering leads one towards that conclusion. Hume's guillotine is an implacable philosophical device: https://www.youtube.com/watch?v=hEUO6pjwFOo https://www.youtube.com/watch?v=hEUO6pjwFOo (I warmly recommend all the content on that delightfully frightening channel)

pixl97 4y ago

Read the Microsoft research paper that came out last week, focus specifically on the section that contains the following... "Equipping LLMs with agency and intrinsic motivation is a fascinating and important direction for future work."

pegasus 4y ago
I've seen that paper, and it's amazing indeed what GPT-4 is capable of. But none of that supports that closing quote, which to me points to a worrying philosophical naïveté. How can one equip an entity with "intrinsic motivation"? By definition, if we have to equip it with it, that motivation is extrinsic. It belongs to the one who puts it there. A software engineer might decide to prompt his creation with something along the lines of "Be fruitful and increase in number; fill the earth and subdue it. Rule over the fish in the sea and the birds in the sky, and over every living creature that moves on the ground." and the bot will duly and with limitless enthusiasm put those wise orders into practice. If that ends up causing some "minor" problems, should we confine the software for one thousand years in an air-gapped enclosure, until it learns a bitter lesson? Or should we take to task the careless Maker of the bot? To me, the answer is obvious. PS: this video to me states the problem in a nutshell (that whole channel is gold) https://www.youtube.com/watch?v=hEUO6pjwFOo https://www.youtube.com/watch?v=hEUO6pjwFOo