3 ms·
The plan was to do it in-house. And buying 8xA100 is a bit too much ;)
by indeyets 3y ago
The plan was to do it in-house. And buying 8xA100 is a bit too much ;)
- FrostKiwi 3y agoI'm in the exactly same boat. Targeting to fine tune llama 2 70b on 2xA100, with the hope of having one A100 run an 8bit quantized 70b model 24/7. If you have an experiences to share, successes or failures, please do.