3 ms·
Actually claude has memory files now so it has some sort of learning, I think it will improve over time and they should survive a model update.
by small_model 8mo ago
Actually claude has memory files now so it has some sort of learning, I think it will improve over time and they should survive a model update.
- verdverm 8mo agoputting stuff in markdown files is not "learning", it's called taking notes, like we've done for 1000s of years
- ben_w 8mo agoSocrates made a similar complaint about the invention of writing, itself.
- small_model 8mo agoI guess when I was in class and took notes, then reviewed them later I wasn't "learning" anything.
- verdverm 8mo agoThat later "learning" part is updating weights in your brain What Ai's get is a cheat sheet for the session
- small_model 8mo agoThat's what I mean by continual learning, skills, memory are a crutch until real learning can happen, which could be weights changing in the local instance.
- verdverm 8mo agoAnd my point is that weight changes are not likely to have the economic ROI for their justification on a person-by-person basis What you are suggesting is a very expensive late-training phase activity. It's also not clear anymore when fine-tuning helps or hurts. Progress is rapid
- small_model 8mo agoI see, I misunderstood your original message. Given how much progress has been made without it, It's perhaps not necessary especially if the economics make it prohibitive.
- jibal 8mo agoReading notes is only necessary because of how lossy human memory is. Reading notes doesn't give you new information, it just reinforces memory paths ... which will fade and you'll have to read the notes again later unless you frequently apply the knowledge, which again reinforces those paths (but lossily, so the bits of information not repeatedly used will fade, and you will again have to read the notes if you need those bits ... or just to re-mind yourself what they were).