The idea is about the LLM trained in a programming language should use as queries the functions, and learn to detect the keys (arguments to the functions) and t

The idea is about the LLM trained in a programming language should use as queries the functions, and learn to detect the keys (arguments to the functions) and the value matrix could be related to a memorized version of the computed function with those arguments. So the sequence of learning in transformers is like: 1) query = is this a function?, what function? 2) keys = where are what are their arguments 3) values = embed the memorized result of computing the function with the given arguments.