3 ms·Run Llama 3 405B on home cluster (Distributed Llama)2 points by b4rtazz 2y agob4rtazz 2y agoTechnically, should be enought 2 machines with 128 GB RAM or 4 machines with 64 GB RAM (Q40 weights).