If you mean train llama from scratch, you aren't going to train it on any single box. But even with a single 3090 you can do quite a lot with LLMs (through QLo

If you mean train llama from scratch, you aren't going to train it on any single box. But even with a single 3090 you can do quite a lot with LLMs (through QLoRA and similar).