Training a 70b model from scratch uses 80,000 GPU hours (4,6 years if you have two of those GPUs). The electricity would cost more than 10,000€ in Germany, jus

Training a 70b model from scratch uses 80,000 GPU hours (4,6 years if you have two of those GPUs). The electricity would cost more than 10,000€ in Germany, just for the GPUs.