4 ms·
> If you read around, training a 7B model costs on the order of $85,000; the 1.4 stable diffusion release cost around $600,000 to train. SD 1.x is a ~1B parame
by dragonwriter 3y ago
> If you read around, training a 7B model costs on the order of $85,000; the 1.4 stable diffusion release cost around $600,000 to train.
SD 1.x is a ~1B parameter model, so its interesting that it cost so much more than a 7B LLM.
- senseiV 3y agoyes the size is different, but training a diffusion model and a language model are really different, like how RL models can be small but take a long time to train aswell