3 ms·
You can fully train a 1.6b model on a single 3090. That’s a reasonably big model.
by mips_avatar 5mo ago
You can fully train a 1.6b model on a single 3090. That’s a reasonably big model.
- electroglyph 5mo agoyou can train it, but not fully
- mips_avatar 5mo agoI trained karpathys d28 1.6b nanochat on a 3090. Took an extremely long time but I did it.