That’s intriguing. I have the same card, maybe I should give it a go. Curious about your CPU/RAM/storage capacity as well. Any resources for configuring the lo

That’s intriguing. I have the same card, maybe I should give it a go. Curious about your CPU/RAM/storage capacity as well. Any resources for configuring the local setup? My entire home media stack is a single compose file in a WSL distro so it would be cool if local LLM worked the same way.