3 ms·
Why do you have ten or so 3090s sitting in boxes? I mean obviously it's worth it just so you can flex on HN. But curious whether there was any other reason? Re
by fancyfredbot 2mo ago
Why do you have ten or so 3090s sitting in boxes?
I mean obviously it's worth it just so you can flex on HN. But curious whether there was any other reason? Retired scalper?
- echelon 2mo agoI ran a popular gen AI audio website on them as an on-prem GPU cluster. 6.5M MAU with $650k ARR at peak. Half the inference happening locally. We got destroyed by bigger players (ElevenLabs, Suno, and more recently Fish) that fundraised and had better in-house models. It was a headache to run, I wanted to pursue a different market (video/creative), and I pivoted. My pivot failed and was dead for over a year as I went too far into controllability. One of my changes then got a semblance of PMF and it's doing $4M annualized run rate (but it's not fundable in its current shape). I ultimately want to build open source cloud infra and open source workflow products - more friendly than Comfy, more free than RunPod. In any case, I can't run my current work on the GPUs. But I'm close enough to pretraining and fine tuning smaller models that I want to use them for future experiments. Not that I wouldn't do that in the cloud.
- fancyfredbot 2mo agoThanks very interesting. Can imagine it being a pain.Ten is an unusual number, hard to divide evenly across hosts. To be honest I doubt you'll ever use them again, especially if you have dismantled the cluster and put them back in their boxes again. The cluster would be cheaper than cloud but you don't seem that cost constrained.