3 ms·
The reason for these articles and the frustration people have is that GPT 4 is a black box and is being changed whether we like it or not. Nobody can choose to
by jiggawatts 3y ago
The reason for these articles and the frustration people have is that GPT 4 is a black box and is being changed whether we like it or not. Nobody can choose to continue to use a specific snapshot with the alignment that suits them, because a third-party is enforcing their preferred alignment -- and not even specifying what that is!
It's as-if a private company had invented portal technology and used it to establish trade routes with far-off alien civilisations. They even handle the purchase order translation, currency conversion, and so on. It's a miracle! You can order room-temperature superconductors and floaty rocks at a reasonable price.
"Sorry, due to high demand, we had to cut some corners on the translations" comes the announcement.
Now the entire human race sometimes gets copper wire and ordinary rocks.
"You're still trading with the exact same aliens" is the follow-up press release to appease the angry customers.
People point at the clear evidence of almost-but-not-superconductive wire they've received and demand answers.
"No, you do not need to know anything at all about our translation technology. No, you may not visit other planets without our express approval, that might be dangerous to our prof... I mean that might be dangerous to the human race. Yes. Dangerous! Existential, even."
- thefurdrake 3y agoI haven't used OpenAI's API, but I might soon, and I've read tangentially that you can specify the checkpoint version in API calls to gpt3.5. Is this not the case with gpt4? Did they backport shitty alignment to older model versions?
- ilaksh 3y agoYes, you can specify the particular snapshot when using the API with gpt-4.
- jiggawatts 3y agoYes, but they deprecate old checkpoints very fast. You also can’t ever use the original version that wasn’t aligned to Sam Altman’s preferred vision. By all accounts there is an “alignment tax” that reduces the capability of these systems. For industrial or large scale public use I would also argue for the well-behaved models to be the only ones used. For personal experimentation I prefer a sassy AI that tells me I’m wrong. Sam insists I’m too immature and I can’t be entrusted with making that choice for myself.