4 ms·
On runpod there is a TheBloke template with everything set up for you. An A6000 is good enough to run 70b 4bit.
by redox99 3y ago
On runpod there is a TheBloke template with everything set up for you. An A6000 is good enough to run 70b 4bit.
loading thread…