You can fine tune without the original training data, which for a large LLM is typically going to mean using LoRA - keeping the original weights unchanged and a

You can fine tune without the original training data, which for a large LLM is typically going to mean using LoRA - keeping the original weights unchanged and adding separate fine-tuning weights.