3 ms·
Yeah I do need the LLM. Currently running 2 old Tesla M40's for 48GB of VRAM. While cheaper than this it has its limitations. Running a 200B model locally is
by apexalpha 2y ago
Yeah I do need the LLM.
Currently running 2 old Tesla M40's for 48GB of VRAM.
While cheaper than this it has its limitations. Running a 200B model locally is very attractive though. Excited for the future.