3 ms·
Show HN: Single-File GGUF Inference
This is a WiP, far from polished, and only partially functional. Though all the bones are here.
Modify and adapt as you see fit. Sorry for any stray slop. I trust you all can take this home. :)
God bless <3