This would involve a lot of effort, but seems to be doable. Here's a starting point that discusses some options: https://huggingface.co/blog/trl-peft https://hu

This would involve a lot of effort, but seems to be doable. Here's a starting point that discusses some options: https://huggingface.co/blog/trl-peft https://huggingface.co/blog/trl-peft