2 ms·
https://d1qx31qr3h6wln.cloudfront.net/publications/Nemotron_4_340B_8T_0.pdf https://d1qx31qr3h6wln.cloudfront.net/publications/Nemotron_... "...Nemotron-4-340B
by belter 2y ago
https://d1qx31qr3h6wln.cloudfront.net/publications/Nemotron_4_340B_8T_0.pdf https://d1qx31qr3h6wln.cloudfront.net/publications/Nemotron_...
"...Nemotron-4-340B-Base was trained using 768 DGX H100 nodes"
That is 350 million dollars for you...Poor Startups, better have a rich sponsor.
- deleted 2y ago[deleted]