2 ms·
Then why wouldn't any LLM trained on real data have structure? I mean we don't live in the chaos realm, atoms make molecules, those molecules make structures,
by pixl97 3y ago
Then why wouldn't any LLM trained on real data have structure?
I mean we don't live in the chaos realm, atoms make molecules, those molecules make structures, those structures make cells, organs, lifeforms.
- hprotagonist 3y agothe degrees to which the (non)deterministic and (non)atomistic models of the universe have predictive power aside — yes, sure: you should expect a well trained NN to have an internal structure that approximates that of the statistical distribution of encoded features of the training data into the latent space of the model. that’s very nearly the definition of “trained”.