3 ms·
> They are doing things with $100 and 13B params that we struggle with at $10M and 540B. Does this mean Bard took $10M to train and it has 540B parameters?
by kccqzy 4y ago
> They are doing things with $100 and 13B params that we struggle with at $10M and 540B.
Does this mean Bard took $10M to train and it has 540B parameters?
- squishylicious 4y agoBard is based on PaLM: https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html https://ai.googleblog.com/2022/04/pathways-language-model-pa.... They haven't published training costs but estimates have been in the $10-20M range, so that seems reasonable.