3 ms·
Is llama performance not basically bound by the memory hierarchy?
by mhh__ 3y ago
Is llama performance not basically bound by the memory hierarchy?
- viraptor 3y agoBound by: yes. Currently restricted by: possibly not. For example the performance difference between clang 11 and 15 compiled llama.cpp is ~10% (I tested a while ago, can't remember the exact number)