3 ms·
No, they aren't.
by olddustytrail 3y ago
No, they aren't.
- mitthrowaway2 3y agoCare to explain why not? An LLM's working memory is just its context window, but the LLM also has embedded data in its parameters, which are set during training to minimize loss. This is effectively a memory of the training data, just as much as a digital photo of my face is a memory of the photons reflecting from my face.
- Der_Einzige 3y agoWhy would you go on HN and say blatantly wrong information AI is literally 1-1 equivalent to compression. If you don't believe me, you should check out this demo of GPT-2 as a (for awhile SOTA) text compressor. Oh its down now, but here's the HN thread to prove this exists: https://news.ycombinator.com/item?id=23618465 https://news.ycombinator.com/item?id=23618465