4 ms·
Don’t forget learning, humans can learn, LLMs do not learn, they are trained before use.
by grey-area 6mo ago
Don’t forget learning, humans can learn, LLMs do not learn, they are trained before use.
- addedGone 6mo agoThey learn on the next update :p
- quantummagic 6mo agoYup. And eventually there will be online learning, that doesn't require a formal update step. People keep conflating the current implementation, as an inherent feature.
- grey-area 6mo agoThat’s training, not learning.
- HighGoldstein 6mo agoDo we? Or are we born with pre-training (all the crucial functions the brain does without us having to learn them) and a context window orders of magnitude larger than an LLM?
- compass_copium 6mo agoIt is incredible how willing and eager AI boosters are to denigrate the incredible miracle of human consciousness to make their chatbots seem so special. No, we are not born with all the pre-training we need. That is rather the point of education, teaching people's brains how to process information in new, maybe unintuitive ways.