4 ms·

Are the 30x claims comparing full update training vs qlora/4bit weights?

• danielhanchen 3y ago
  Sorry about the confusion - the 30X is comparing QLora with QLora - all benchmarking is QLoRa bsz=2, ga=4