regexorcist

6 ms·

1. 91.▲
   by regexorcist 6mo ago

   I have a 64GB M1 Ultra dedicated to llama.cpp. I get 40 tok/s on a fresh session, decreasing slowly to about 25 tok/s at around 50% of the 256K context, then down to 20 tok/s or less beyond that, but I rarely let it go much h
2. 92.▲
   by regexorcist 6mo ago

   Things like these (Google also banned me from Antigravity for briefly using an agent) and the massive quality swings made me cancel all 3 subs last week and resort to my local Qwen 3.6 only. Open models are already great and only getting be
3. 93.▲
   by regexorcist 6mo ago

   Great project, seems off to a good start with its first HN hug of death. Meanwhile GitHub greets me this morning with the banner "Don't worry if you have missing PRs at the moment, data isn't lost".