2 ms·
I really dislike how Antropic half reports on its "science". They run a bunch of experiments, for some they report partial metrics, for other's no metrics at a
by RansomStark 1y ago
I really dislike how Antropic half reports on its "science".
They run a bunch of experiments, for some they report partial metrics, for other's no metrics at all.
For example when a thought is injected the model correctly identified the thought 20% of the time.
That's great, but how many times did it suggest there was an injected thought when there wasn't?
When distinguishing thoughts from text: why no metrics? Was this behaviour found in every test? Was this behaviour only found 20% of the time? How often did the model try to defend the text?
Inquiring minds want to know.
- colah3 1y ago(Disclaimer: I work on interpretability at Anthropic.) I wanted to flag that this is an accessible blog post and that there's a link to the paper ( https://transformer-circuits.pub/2025/introspection/index.html https://transformer-circuits.pub/2025/introspection/index.ht... ) at the top. The paper explores this in more detail and rigor.