3 ms·
Again, abstraction allows for domain-specific language which shapes the way a problem is interpreted and solved. Perspective is everything, and it's hard to ha
by soulofmischief 2y ago
Again, abstraction allows for domain-specific language which shapes the way a problem is interpreted and solved.
Perspective is everything, and it's hard to have perspective of the entire system on the ground floor. Getting the priors right, or getting the LLM to first consider different grammars can greatly simplify the problem and its solution.
You can think of learning as decontextualization of input data into pure relational constructs. Application, then, is the recontextualization of some relational construct in order to apply generalized relations and insights to problems of different shapes and sizes. Understanding a concept thus means mastering the decontextualization and recontextualization of a set of relations.
Using a DSL instead of pure machine code is an example of recontextualization, and it can totally change how a model understands and processes input and what kind of output is produced.