2 ms·
BitDelta: Your Fine-Tune May Only Be Worth One Bit
- convexstrictly 3y agohttps://github.com/FasterDecoding/BitDelta https://github.com/FasterDecoding/BitDelta
- convexstrictly 3y ago"By enabling the use of a single high-precision base model accompanied by multiple 1-bit deltas, BitDelta dramatically reduces GPU memory requirements by more than 10x, which can also be translated to enhanced generation latency in multi-tenant settings."