2 ms·
TBH, this is what most "open LLM" community is researching right now. Most LORAs or custom models are 7B and sometimes 13B quantized. They fit into 24 GB vram n
by eurekin 3y ago
TBH, this is what most "open LLM" community is researching right now. Most LORAs or custom models are 7B and sometimes 13B quantized. They fit into 24 GB vram nicely