3 ms·
An H100 is maybe a car but not nearly close to a house...
by Zetobal 3y ago
An H100 is maybe a car but not nearly close to a house...
- KomoD 3y agoMaybe not in your area, but it's very doable in other places, like where I live.
- ShamelessC 3y agoYou expect me to believe there are other places than where I live?!
- nextaccountic 3y agoIs a single H100 enough?
- brucethemoose2 3y ago80GB is enough, yeah. I'm not sure what exact LORA/quantization settings would be ideal, but check out https://github.com/OpenAccess-AI-Collective/axolotl#config https://github.com/OpenAccess-AI-Collective/axolotl#config
- ioedward 3y ago8 H100s would have enough VRAM to finetune a 70B model.