4 ms·
Do you think the right penatly for a piece of broken code is a thousand years of suffering?
by stared 4mo ago
Do you think the right penatly for a piece of broken code is a thousand years of suffering?
- gobdovan 4mo agoWell, the problem is that current LLMs are stateless, so a thousand subjective years is not well-defined. Without continuity of experience, persistent memory, engineered aversive stimuli and without updating weights meaninguflly during the punishment interval, we are merely doing the equivalent of simply updating a model to believe it just suffered a thousand years. Only once we have all these right ingredients we can empirically determine whether a thousand years is excessive, insufficient, or the local optimum for reducing Claude overwriting that damn CSS color palette.
- stared 4mo agoBlack Mirror episodes White Christmas and Black Museum deal with this issue (my favorite picks from the Black Mirror).
- recursive 4mo agoIf an LLM was capable of feeling suffering, I would suggest that creating one would be unethical, and that humans should not do it.