3 ms·
Can you share your local LLM setup?
by throwaway7783 4mo ago
Can you share your local LLM setup?
- mystraline 4mo agoIts just my desktop running Krasis. 96GB ddr5, 16GB nvidia 5060. Im running qwen-3.5-80B in int4 mode. It uses like 45GB system ram and 11GB g-ram.