quarterbit

4 ms·

1. 1.▲
   by quarterbit 7mo ago

   Please download our Collab Blackwell training results on a 70b Llama model for review https://quarterbit.dev/data/QuarterBit_AXIOM_70B.ipynb . This should be impossible and yet here it is.
2. 2.▲
   by quarterbit 7mo ago

   Thanks for the tip! It won't let me edit it. I think I will hide and repost it does look sloppy.
3. 3.▲
   QuarterBit – Train 70B LLMs on a single GPU(quarterbit.dev)

   3 points by quarterbit 7mo ago|4 comments
4. 4.▲
   by quarterbit 7mo ago

   I built QuarterBit because AI training costs are insane. A 70B model needs 840GB of memory — that's 11 A100 GPUs at $30+/hour. QuarterBit AXIOM compresses training memory 15x. Same model. Same quality. Fraction of the hardware. RE