2 ms·
122b is probably better; especially on a mac with 128gb memory. localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen35122b_basi
by jonaustin 7mo ago
122b is probably better; especially on a mac with 128gb memory.
localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen35122b_basically_has_no_advantage_over_35b/ https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen351... (see comments for actual real usage rather thank benchmarks)
But for nvidia gpus 27b on a 3090 or similar is where it's at for sure.