3 ms·
I guess that depends on what you think is coherent. A key finding is that the larger the network the more coherent the representation becomes. One example is la
by iNic 1y ago
I guess that depends on what you think is coherent. A key finding is that the larger the network the more coherent the representation becomes. One example is larger networks merge the same concept across different languages into a single concept (as humans do). The addition circuits are also fairly easy to interpret.
- quonn 1y ago> merge the same concept It's doing compression which does not mean it's coherent. > The addition circuits are also fairly easy to interpret. The addition circuits make no sense whatsoever. It's doing great at guessing that's all.
- iNic 1y agoI am curious, what would you count as coherent? I think it is absolutely insane that we can open and understand what are essentially alien intelligences at all!