3 ms·

will it run on 2x 5060Ti with 16GB each?

• skohan 2mo ago
  It should - the kquant-dynamic variant is targeted towards 32GB. Downloading it now to give it a try.
• leansensei 2mo ago
  It does, beautifully. Now let's wait for an NVFP4 GGUF!
• BoredomIsFun 2mo ago
  yes. you can even parallelize two cards and get 1.7 times the speed.