3 ms·
Load a large language model in 4bit and train it using Google Colab and PEFT
- ritabratamaiti 3y agoFrom the Huggingface blog post: Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA (https://huggingface.co/blog/4bit-transformers-bitsandbytes https://huggingface.co/blog/4bit-transformers-bitsandbytes)