Soft prompts for language models are still viable, but the most accessible version of open source soft prompt training was a TPU-based implementation that depen

Soft prompts for language models are still viable, but the most accessible version of open source soft prompt training was a TPU-based implementation that depended on features of Google Colab that were no longer available. You can modify it to run locally on a GPU, though it is a bit slow to train. It provides different advantages when compared to a LoRA.