You can often sorta estimate it but multiply it with like 2/3rds give or take a lot to work out how much vram you need. 27B will fit onto a 24gb card with dece

You can often sorta estimate it but multiply it with like 2/3rds give or take a lot to work out how much vram you need. 27B will fit onto a 24gb card with decent context and a couple GB for operating system to spare at Q4. tok/s doesn't really have a good way to eyeball it