2 ms·
How are they handling attention in their approach? That’s going to completely change what features are looked at.
by bilsbie 2y ago
How are they handling attention in their approach?
That’s going to completely change what features are looked at.
- tel 2y agoThey target the residual stream. Also they may have a definition of “feature” that’s more general than what you’re using. Consider reading their superposition work.