2 ms·
Too much context pollution. Start with short text context, and flow through DAGs via choose your own adventure. We alreadybreached context limits. Nows the tim
by cyanydeez 7mo ago
Too much context pollution.
Start with short text context, and flow through DAGs via choose your own adventure. We alreadybreached context limits. Nows the time to let LLMs build their contexts through decision trees and prune dead ends.
- j-pb 7mo agoIn my experience a wiki can actually drastically reduce the amount of dead context. I've handed my local agents a bunch of integrated command line tools (kinda like an office suite for LLMs), including a wiki (https://github.com/triblespace/playground/blob/main/faculties/wiki.rs https://github.com/triblespace/playground/blob/main/facultie... ) and linkage really helps drastically reduce context bloat because they can pull in fragment by fragment incrementally.
- cyanydeez 7mo agoWas also thinking to disambiguate context where you wish to express a tokens function (eg, top) as different from one could use unique ASCII prefix (eg, ∆top) to avoid pollution between the english and the linux binary. Youd then alias these disambiguated terms and theyd still trigger the correct token autocomplete but would reduce overlap which cause misdirection.