2 ms·
Yeah, exactly. LLaMA 7B itself cost $80,000+ to train (82,432 GPU hours). Stanford spent $100 on fine-tuning compute and $500 on OpenAI credits to generate the
by simonw 4y ago
Yeah, exactly. LLaMA 7B itself cost $80,000+ to train (82,432 GPU hours). Stanford spent
$100 on fine-tuning compute and $500 on OpenAI credits to generate their 52,000 sample instruction training set.