3 ms·
> Generation is speedy at about ~4 seconds per generation May I ask on which GPU & VRAM? edit: oh unless you just meant through huggingface's UI
by skipants 1y ago
> Generation is speedy at about ~4 seconds per generation
May I ask on which GPU & VRAM?
edit: oh unless you just meant through huggingface's UI