4 ms·
Yeah, OpenAI do have harmfulness classifiers in ChatGPT that can detect problems in their own responses before it finishes, and learning how confident GPT-5 or
by luke-stanley 1y ago
Yeah, OpenAI do have harmfulness classifiers in ChatGPT that can detect problems in their own responses before it finishes, and learning how confident GPT-5 or the image generator tool call should be about meeting the brief, after it finishes describing the visual concept, might be a task OpenAI could train a classifier on.
But reliably predicting ahead of time can be a really hard problem to solve; knowing how successful a complicated tool will be, before it actually starts or finishes the task attempt is tricky.
After gpt-image-1 has produced an image is another helpful intervention point, it can do a better self-review for detecting problems after image generation, but it's still not very thorough.
However OpenAI has small teams, they try to keep them small and really focused, and everything is always changing really fast, they probably have gpt-image-2 or something else soon anyway.
In a way, reliable prediction is the main job OpenAI has to solve, and always has been.
Some researches say the main way models are trained causes "Entangled Representations", which makes them unreliable.
They also suffer from the "Reverse Curse". Maybe when they fix these issues, it might be real AGI and ASI all in one go?