4 ms·
What is an LLM, if not a probabilistic compression scheme?
by tedunangst 2y ago
What is an LLM, if not a probabilistic compression scheme?
- mistercow 2y agoThat’s an interesting rhetorical trick, because answering the question “what is an LLM” requires a lecture series, not a hacker news comment.
- unusualmonkey 2y agoCompression schemes take an item, reduce it in size, and return the same item (lossy or lossless) when asked. LLM's and other generative AI are not designed nor are particularly good at this. What they are good at is returning new results using 'learning' it has developed via training. If I want to send someone a sample of code, I'll use zip. If I want to generate code from a prompt, I'll use a llm.