mkw

3 ms·

1. 1.▲
   by mkw 7mo ago

   stream from the SSD, perform the calculation, discard, repeat
2. 2.▲
   by mkw 7mo ago

   TLDR I took a stab at leveraging Dan's work and making it more practical: https://github.com/matt-k-wong/mlx-flash 2 bit quantization lobotomizes the model but is impressive nonetheless! Maybe one day we'll
3. 3.▲
   by mkw 6y ago

   Very cool!