4 ms·
The key to make Copilot useful is to take the limited context problem seriously enough. There are many dimensions to it: https://zby.github.io/commonplace/notes
by zby 7mo ago
The key to make Copilot useful is to take the limited context problem seriously enough. There are many dimensions to it: https://zby.github.io/commonplace/notes/context-efficiency-is-the-central-design-concern-in-agent-systems/ https://zby.github.io/commonplace/notes/context-efficiency-i... and it should be the starting point for designing the systems that extensively use llms.
- andai 7mo agoWell, did you solve the problem of deciding what to remember? (And I suppose, how to retrieve it? i.e. LLM can retrieve info, but if it doesn't know about something because it hasn't been retrieved yet...)
- zby 7mo agoThere are many techniques - I analyse them at my knowledge base. I wrote 'my bet is that solving ...' - if I have solved it I would not have to hedge like this.