Oh I compared 4bit QLoRA HF+FA2 with Unsloth 4bit QLoRA. 16bit LoRA have similar boosts in performance! Full bf16 full finentuning is not yet supported, but i

Oh I compared 4bit QLoRA HF+FA2 with Unsloth 4bit QLoRA. 16bit LoRA have similar boosts in performance! Full bf16 full finentuning is not yet supported, but it'll come out soon!