3 ms·
My DGX spark cluster is humming along.
by nightski 3mo ago
My DGX spark cluster is humming along.
- dist-epoch 3mo agoI've used 200 mil tokens of GPT-5.6 Sol today. How many can your cluster produce per day? (obviously of whatever model you are running)
- nightski 3mo agoSo you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :)
- dist-epoch 3mo agoNo, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached.
- dd8601fn 3mo agoIt’s not even a sensible comparison. You run way better models, whatever is newest, for the five years it takes for the “spark cluster” to even reach cost parity with far worse performance. Those things aren’t spectacular at inference… it’s not really why you drop that kind of money on them.
- deleted 3mo ago[deleted]
- panarky 3mo agoWhat are we optimizing for again?
- cartermatic 3mo agoShareholder value
- raattgift 3mo agoInvestor interest, but not the excess above principal sum kind of interest, and not investors' interests.
- guessbest 3mo agoInternet comments