3 ms·
I think it’s different, unless you believe LLMs have broken theoretical limits on compression. I don’t see how an LLM with 1T 16 bit parameters could encode 100
by brookst 2y ago
I think it’s different, unless you believe LLMs have broken theoretical limits on compression. I don’t see how an LLM with 1T 16 bit parameters could encode 100PB of data.
- oblio 2y agoMy point was about attack angles. The original comment said, that for example, you could exfiltrate data with the right prompt attack. To which the reply was "they'll just make the LLM able to better defend itself". And my point was "the attackers will learn to build better prompts, too".