3 ms·
We do the same thing. We have long term memory and short term. Context is short term. The still long and expensive training phase embeds the long term memory
by Flemlo 1y ago
We do the same thing.
We have long term memory and short term.
Context is short term.
The still long and expensive training phase embeds the long term memory.
- queenkjuul 1y agoWhat we do may be analogous but absolutely not the same
- Flemlo 1y agoYes if course after all ML and LLM are not made out of brain. But do I really have to say colloquial?
- AnimalMuppet 1y agoHmm, interesting. One of the problems programmers have is loading a problem into working memory. It can take an hour. An interruption, a phone call, or a meeting can mean that you have to start over (or, if not completely over, you still have to redo part of it). This is a standard programmer complaint about interruptions. It's interesting that LLMs may have a similar issue.
- 29athrowaway 1y agoWe do not do the same thing. Right now inference doesn't cascade into training. In biology, inference and training are not so decoupled.