3 ms·

Largest R1, as in the 671B? How do you accomplish that feat?

• oynqr 2y ago
  Just do it? Llama.cpp doesn't load the entire thing into ram. It mmaps the file and the kernel takes care of the rest.