"This setup would be great for deepseek v3 or (more fittingly) the 405B llama 3.1 model" v3 yes w/ 37B activated params, yes, but terrible on 405B as it's a de

"This setup would be great for deepseek v3 or (more fittingly) the 405B llama 3.1 model" v3 yes w/ 37B activated params, yes, but terrible on 405B as it's a dense model.