3 ms·
So, you don't know what it is, either.
by SwellJoe 3mo ago
So, you don't know what it is, either.
- Wetime 3mo agoWe handeld llm like a human brain we decopelled knowledge from the memory and build a memory layer that makes redoing things free and fast, so the llm can once it learned something solves it for free the next time
- saidnooneever 3mo agothis sounds like ur explaining caching
- SwellJoe 3mo agoSounds like they're explaining magic. Because current models cannot learn and they cannot remember.
- saidnooneever 3mo agothere is RL for LLMs which actually changes the weights but its more specialization than learning and wont counter the probabalistic nature of the thing
- SwellJoe 3mo agoTraining is not something you can just bolt on, and it generally requires even larger hardware than inference for a given model, and a huge amount of time. If you're aiming for "free", a OP claims, RL aint it.