3 ms·
I am plan on getting a RTX 4090 but I wish it had a bit more vram.
by tmaly 3y ago
I am plan on getting a RTX 4090 but I wish it had a bit more vram.
- eurekin 3y agoTBH, this is what most "open LLM" community is researching right now. Most LORAs or custom models are 7B and sometimes 13B quantized. They fit into 24 GB vram nicely