2 ms·

You don't just need a context, you need to finetune a model around that context since working memory isn't enough. That is what human workers do, they spend the

You don't just need a context, you need to finetune a model around that context since working memory isn't enough. That is what human workers do, they spend the first months finetuning their model around the company context before they can start to provide valuable code. Once you can pay to get your own fine tuned version of the big LLMs maybe we can start to do real work with these.

from-nibly 3y ago
Agreed on the first part. However my point is that having the context and the ability to use it is sooooooo far out of reach for a computer it's unfathomable. In much the same way how life is unfathomable at some level. It's this self referencing infinity that is somehow collapsing into results while being uncollapseable. Computers can't do that not without something fundamentally different