2 ms·

Cryptography, I guess? Not really related to LLMs...

• zhoBEENG 4mo ago
  Crypto and AI are deeply connected, and you see similar structures/problems in both. Shannon, the “Father (or whatever) of AI”, worked for the NSA and published many papers there that were later declassified. Here is a banger quote on this by Shannon’s boy Warren Weaver, keeping in mind LLMs came from translation problems: “One naturally wonders if the problem of translation could conceivably be treated as a problem in cryptography. When I look at an article in Russian, I say: 'This is really written in English, but it has been coded in some strange symbols. I will now proceed to decode.”
  • nl 4mo ago
    > Crypto and AI are deeply connected, and you see similar structures/problems in both. I mean yes, in both deal with information theory. That's a long way from any practical insight.