3 ms·

Are modern NN's really just static functions, and are they going to continue to be in the future? KV caching is directly in conflict with a purely functional a

Are modern NN's really just static functions, and are they going to continue to be in the future? KV caching is directly in conflict with a purely functional approach.

visarga 2y ago
You could sen the KV cache and even the LoRA as input args to a static model.
spott 2y ago
Is it? The same inputs have the same outputs, the only thing different is the performance. It is basically the same as memorization.