4 ms·
Isn't the price of an H800 like $30k? I don't know what your household budget is, but $60M might not be what most people associate with "some capital".
by ArtTimeInvestor 2y ago
Isn't the price of an H800 like $30k?
I don't know what your household budget is, but $60M might not be what most people associate with "some capital".
- andai 2y agoYesterday GPT asked me if I'd like to train a small LLM and I laughed out loud. That being said I'm amazed how far 1B models have come. I remember when TinyLlama came out a few years ago, it was not great. ($40K training cost iirc.) That was a 1B model, but these days even 0.5B models are remarkably coherent.
- chvid 2y agoIt is a lot less than what Google, OpenAI etc have. And the GPUs would be a shared resource so what you should calculate is what it would have cost to rent them - probably something like 2 m.