3 ms·
I am interested to see how the concept longterm memory is developed with LLMs. It seems very slow to use fine tuning for this process. On the topic of summariz
by tmaly 4y ago
I am interested to see how the concept longterm memory is developed with LLMs. It seems very slow to use fine tuning for this process.
On the topic of summarizing and determinism, I wonder if an intermediate bytecode loke language or structured subset of the English language could improve the outcome across models.
- deleted 4y ago[deleted]
- LesZedCB 4y agoI want to see huge context where fine-tuning could happen as something like a digest at the arrival of the end of the context window. so amortized cost is low.