3 ms·2x3090s run 70B at 4bit pretty well. Dolphin does great at least for chat. Very coherent.by aimonster2 3y ago2x3090s run 70B at 4bit pretty well. Dolphin does great at least for chat. Very coherent.