1. The best hardware you can afford. 2. Take a look at huggingface.co 3. Rent for shot periods, buy if you need it for a long time. You can do the maths. 4.

1. The best hardware you can afford. 2. Take a look at huggingface.co 3. Rent for shot periods, buy if you need it for a long time. You can do the maths. 4. Smaller models, quantization, running on CPU when the speed and increased energy usage isn’t a problem.