2 ms·
Is a single H100 enough?
by nextaccountic 3y ago
Is a single H100 enough?
- brucethemoose2 3y ago80GB is enough, yeah. I'm not sure what exact LORA/quantization settings would be ideal, but check out https://github.com/OpenAccess-AI-Collective/axolotl#config https://github.com/OpenAccess-AI-Collective/axolotl#config