4 ms·
Why not apply it at an earlier layer then?
by HeatrayEnjoyer 2y ago
Why not apply it at an earlier layer then?
- anonymoushn 2y agoAt earlier layers the activations don't correspond as cleanly to tokens, and I expect that vendor APIs for proprietary LLMs wouldn't let you do anything like this.