Most probably they are doing something called prompt tuning. This creates a small ai model that adds virtual tokens to prompt before passing to original model:

Most probably they are doing something called prompt tuning. This creates a small ai model that adds virtual tokens to prompt before passing to original model: https://developer.nvidia.com/blog/an-introduction-to-large-language-models-prompt-engineering-and-p-tuning/ https://developer.nvidia.com/blog/an-introduction-to-large-l...