3 ms·Full F16 precision 34B Code Llama at >20T/s on M2 Ultra17 points by Jimmc414 3y agoJimmc414 3y agohttps://github.com/ggerganov/llama.cpp/pull/2926 https://github.com/ggerganov/llama.cpp/pull/2926gary_0 3y agohttps://nitter.net/ggerganov/status/1697262700165013689 https://nitter.net/ggerganov/status/1697262700165013689 (full thread without requiring login)