2 ms·16Gb is minimum to run 7B model with float16 weights; out of the box, with no further efforts.by novaRom 3y ago16Gb is minimum to run 7B model with float16 weights; out of the box, with no further efforts.