2 ms·

is 16Gb "lots of RAM" in an LLM world? How many of these would you need to stack on a motherboard to inference a decent size model?

• oblio 2mo ago
  At least 4, probably 6+.