I know it’s not average person money, but the average person is not looking for hardware to run inference on LLMs. A100 seem in the €15k ballpark and H100 doub

I know it’s not average person money, but the average person is not looking for hardware to run inference on LLMs. A100 seem in the €15k ballpark and H100 double that. Lot of money but I am actually surprised. A dedicated regular guy could buy this. I mean people buy cars and don’t really need them either. Again not saying it is a bargain, but it’s not billionaires only territory and that is good news (it’s early days!).