2 ms·
I actually think this is a great reminder to how much things can be optimized. Especially if we are talking about research code. All too often I see people poin
by godelski 2y ago
I actually think this is a great reminder to how much things can be optimized. Especially if we are talking about research code. All too often I see people point to python code and talk about it being slow as if someone couldn't rewrite it in C for massive improvements. llama.cpp is a great example of this and there's lots of similarly low hanging fruit in ML