3 ms·
>> Claude can speak dozens of languages. What language, if any, is it using "in its head"? I would have thought that there would be some hints in standard embe
by osigurdson 2y ago
>> Claude can speak dozens of languages. What language, if any, is it using "in its head"?
I would have thought that there would be some hints in standard embeddings. I.e., the same concept, represented in different languages translates to vectors that are close to each other. It seems reasonable that an LLM would create its own embedding models implicitly.
- generalizations 2y agoWho's to say Claude isn't inherently a shape rotator, anyway?
- iNic 2y agoThere are: https://transformer-circuits.pub/2025/attribution-graphs/biology.html#dives-multilingual https://transformer-circuits.pub/2025/attribution-graphs/bio...