3 ms·
This is what i have https://sabareesh.com/posts/llm-rig/ https://sabareesh.com/posts/llm-rig/ All You Need is 4x 4090 GPUs to Train Your Own Model
by sabareesh 1y ago
This is what i have https://sabareesh.com/posts/llm-rig/ https://sabareesh.com/posts/llm-rig/
All You Need is 4x 4090 GPUs to Train Your Own Model
- yapyap 1y ago4 4090s is easily 8000$, nothing to scoff at IMO
- ge96 1y agoImagine some SLI 16 x 1080
- dr_kiszonka 1y agoCould you explain what is your use case for training 1B models? Learning or perhaps fine tuning?
- sabareesh 1y agoLearning, prototype and then scale it in to cloud. Also can be used as inference engine to train another model if you are using model as a judge for RL.
- dr_kiszonka 1y agoVery neat. Thanks. Since you know more about it than I, how do the lessons learned in training small models translate to scaling them up? If that is too much to explain, would you be able to recommend something to read about it?