3 ms·
I don't know about llama.cpp, but yes this method works best if the binary layout on disk is exactly what you use for matrices in memory
by petters 3y ago
I don't know about llama.cpp, but yes this method works best if the binary layout on disk is exactly what you use for matrices in memory