If we care about cost efficiency when running LLMs, the most important things are: 1. Don't use AWS, because it's one of the most expensive cloud providers 2.

If we care about cost efficiency when running LLMs, the most important things are: 1. Don't use AWS, because it's one of the most expensive cloud providers 2. Use quantized models, because they offer the best output quality per money spent, regardless of the budget This article, on the other hand, focuses exclusively on running an unquantized model on AWS...