4 ms·13B fits nicely even in a 3090 (24gb vram)!by cuuupid 4y ago13B fits nicely even in a 3090 (24gb vram)!Filligree 4y agoOnly if you can use int8, which may or may not be convenient.lxe 4y agowith load_in_8bits ?grishka 4y agoDoes that mean I would be able to run it on an M1 Max with 64 gb unified memory?