3 ms·
Great question - I'm actually not sure - I'll probably write up some minimum requirements - I know QLoRA's paper https://arxiv.org/pdf/2305.14314.pdf https://ar
by danielhanchen 3y ago
Great question - I'm actually not sure - I'll probably write up some minimum requirements - I know QLoRA's paper https://arxiv.org/pdf/2305.14314.pdf https://arxiv.org/pdf/2305.14314.pdf has an approximate calculation of the weights size, but not the gradient updates