3 ms·
i have same 255h and i was able to run it with low token speed 6-8tg/s with approx similar context window 60k
by pdyc 2mo ago
i have same 255h and i was able to run it with low token speed 6-8tg/s with approx similar context window 60k
- madduci 2mo agoInteresting. What are you using? I was using ollama
- NamlchakKhandro 2mo agoDon't bother with plans
- pdyc 2mo agoi am using llama.cpp with pi harness on linux(cachyos). some of the things like coopmat are disabled in linux due to intel driver issues otherwise performance would be even better.