3 ms·
Is this Garcon [1], or a new tool? [1]: https://transformer-circuits.pub/2021/garcon/index.html https://transformer-circuits.pub/2021/garcon/index.html
by ofou 1y ago
Is this Garcon [1], or a new tool?
[1]: https://transformer-circuits.pub/2021/garcon/index.html https://transformer-circuits.pub/2021/garcon/index.html
- e_ameisen 1y agoHi, paper author here. This is a new tool which relies on existing introspection libraries like TransformerLens (which is similar in spirit to Garcon) to build an attribution graph. This graph displays intermediate computational steps the model took to sample a token. For more details on the method, see this paper: https://transformer-circuits.pub/2025/attribution-graphs/methods.html https://transformer-circuits.pub/2025/attribution-graphs/met.... For examples of using it to study Gemma 2, check out the linked notebooks: https://github.com/safety-research/circuit-tracer/blob/main/demos/circuit_tracing_tutorial.ipynb https://github.com/safety-research/circuit-tracer/blob/main/...) We also document some findings on Claude 3.5 Haiku here: https://transformer-circuits.pub/2025/attribution-graphs/biology.html https://transformer-circuits.pub/2025/attribution-graphs/bio...)