4 ms·
I ran a popular gen AI audio website on them as an on-prem GPU cluster. 6.5M MAU with $650k ARR at peak. Half the inference happening locally. We got destroyed
by echelon 2mo ago
I ran a popular gen AI audio website on them as an on-prem GPU cluster. 6.5M MAU with $650k ARR at peak. Half the inference happening locally.
We got destroyed by bigger players (ElevenLabs, Suno, and more recently Fish) that fundraised and had better in-house models.
It was a headache to run, I wanted to pursue a different market (video/creative), and I pivoted.
My pivot failed and was dead for over a year as I went too far into controllability. One of my changes then got a semblance of PMF and it's doing $4M annualized run rate (but it's not fundable in its current shape).
I ultimately want to build open source cloud infra and open source workflow products - more friendly than Comfy, more free than RunPod.
In any case, I can't run my current work on the GPUs. But I'm close enough to pretraining and fine tuning smaller models that I want to use them for future experiments. Not that I wouldn't do that in the cloud.
- fancyfredbot 2mo agoThanks very interesting. Can imagine it being a pain.Ten is an unusual number, hard to divide evenly across hosts. To be honest I doubt you'll ever use them again, especially if you have dismantled the cluster and put them back in their boxes again. The cluster would be cheaper than cloud but you don't seem that cost constrained.