This is what I use on Windows 10. I have an HP z440 with an E5-1630 v4 and 64GB DDR4 quad channel RAM. I run LLMs on my CPU, and the 7 billion parameter model

This is what I use on Windows 10. I have an HP z440 with an E5-1630 v4 and 64GB DDR4 quad channel RAM. I run LLMs on my CPU, and the 7 billion parameter models spit out text faster than I can read it. I wish it supported LMMs (multi modal models.)