3 ms·
I tried for a bit, with llama.cpp + Qwen + Mac Pro but the results were very poor (both quality and speed). I considered investing in better hardware but doing
by BiraIgnacio 4mo ago
I tried for a bit, with llama.cpp + Qwen + Mac Pro but the results were very poor (both quality and speed).
I considered investing in better hardware but doing the math, it is cheaper for me to pay for DeepSeek (yeah, I know not everyone can do that).