4 ms·
I wonder if OpenAI themselves even know how the resulting black box actually operates? They know how to train it, sure, but do they understand how it approaches
by jug 3y ago
I wonder if OpenAI themselves even know how the resulting black box actually operates? They know how to train it, sure, but do they understand how it approaches the end results?
- simonw 3y agoI'm pretty confident they don't, and I think they might openly admit that. There's a lot of ongoing research into interpretability of these models. Anthropic put out a major new paper about that a few days ago: https://www.anthropic.com/index/decomposing-language-models-into-understandable-components https://www.anthropic.com/index/decomposing-language-models-...