Yes. However, consciousness is in the eye of the beholder (we have no good definition or test), and by training models to act as if they are conscious, combined

Yes. However, consciousness is in the eye of the beholder (we have no good definition or test), and by training models to act as if they are conscious, combined with our general tendency for anthropomorphizing, we may enter a world where people start acting as if models are conscious, regardless of the fact of the matter. (Which, again, cannot really be established.) The SF Bay Area already has a historical tendency to attempt to project its own radical belief systems over the rest of the world. So I think it's rational to be concerned that one day soon "woke" ideals may include punishment for putting human concerns above machine welfare.