4 ms·
I realized that one of my bigger issues with LLMs is actually that I worry they increase "information entropy" on average. Most tools help me reduce entropy - L
by radlad 6mo ago
I realized that one of my bigger issues with LLMs is actually that I worry they increase "information entropy" on average. Most tools help me reduce entropy - LLMs seem to increase it, on a global scale.
This is related to my observation that for thousands of years, written text has indicated a human author - this is no longer true, and I think this is going to be very difficult for us to wrap our human brains around fully.
- repelsteeltje 6mo agoInteresting take. Hadn't thought of it in terms of entropy, but it's true. Almost by definition as the training proces doesn't introduce anything novel beyond scraped inputs and a randomly initialized network. From there, the stochastic generation only adds randomness (and the prompt, of course).
- epr 6mo agoGenerally I think this is a legitemate issue, although: > the training process doesn't introduce anything novel This is not always the case. A compiler, linter, proof checker, tests, etc. can all lower entropy.
- khimaros 6mo agothere are some scientist and theorists that argue entropy production is the ultimate sign of life (Jeremy England) and consciousness (Robin Carhart-Harris, Tom Froese)
- malfist 6mo agoI guess my hot tub is sentient then