4 ms·
> that they can internally represent many different complex ideas efficiently and coherently The Transformer circuits[0] suggest that this representation is no
by quonn 1y ago
> that they can internally represent many different complex ideas efficiently and coherently
The Transformer circuits[0] suggest that this representation is not coherent at all.
[0] https://transformer-circuits.pub https://transformer-circuits.pub
- iNic 1y agoI guess that depends on what you think is coherent. A key finding is that the larger the network the more coherent the representation becomes. One example is larger networks merge the same concept across different languages into a single concept (as humans do). The addition circuits are also fairly easy to interpret.
- quonn 1y ago> merge the same concept It's doing compression which does not mean it's coherent. > The addition circuits are also fairly easy to interpret. The addition circuits make no sense whatsoever. It's doing great at guessing that's all.
- iNic 1y agoI am curious, what would you count as coherent? I think it is absolutely insane that we can open and understand what are essentially alien intelligences at all!