2 ms·
> anthropomorphize LLMs (...) gradient descent (...) backpropagation (...) needs and rights You misunderstood me. I was talking about something more fundamenta
by TeMPOraL 3y ago
> anthropomorphize LLMs (...) gradient descent (...) backpropagation (...) needs and rights
You misunderstood me. I was talking about something more fundamental.
Understanding is data compression. They are the same thing. Learning patterns, building mental models, creating abstractions, generalizing, gaining intuition/a feel for something - all the things humans engage in as part of learning and understanding the world - are all acts of lossy data compression.