3 ms·
They are not hiding anything, because this is standard behaviour for all current optimisers. You still get a massive memory improvement from lower bit model wei
by sigmoid10 2y ago
They are not hiding anything, because this is standard behaviour for all current optimisers. You still get a massive memory improvement from lower bit model weights during training.
- llm_trw 2y agoI'm sorry but you just don't understand what the paper is saying.