3 ms·
>You couldn’t buy one of these if you wanted to right now. You can: https://www.exxactcorp.com/Exxact-TS4-149591758-E149591758 https://www.exxactcorp.com/Exxac
by ericd 1mo ago
>You couldn’t buy one of these if you wanted to right now.
You can: https://www.exxactcorp.com/Exxact-TS4-149591758-E149591758 https://www.exxactcorp.com/Exxact-TS4-149591758-E149591758 . You can get thousands of tps of GLM 5.3 output out of this thing, which grades around Opus 4.8. Payoff is around 1 year vs. spot prices on these GPUs, including power.
- CamperBob2 1mo agoI can't tell from the ad -- it says "supports" 8x MI350X GPUs, but does that mean "includes" 8x MI350X GPUs? For $300K I'd certainly hope so, but I'm assuming not. A system with 4x RTX 6000s costs about $60K these days, and can (as you note) trade blows with Opus 4.8 if not Fable. In fact, it'll give you a better pelican than Fable 5.1, and in less time.
- ericd 1mo agoHa fair, I'd definitely confirm with a salesperson before wiring them $300k. But most of the signs on the configurator seem to point to it including the GPUs? Not going to make 30k BTUs/hr of heat without the 8kw of GPUs.
- Aurornis 1mo ago> trade blows with Opus 4.8 if not Fable. Okay I love the open models, but the hype is getting ridiculous. The models you can run on 4 X RTX6000 are not Fable level.
- CamperBob2 1mo agoWell, they are if you're into animating pelicans. :-P But yes, in the general case Opus is a better match. And Opus is no slouch. I'm satisfied that GLM 5.3 is just as strong as Opus. Z.AI has promised/bragged that they will be at Fable 5.0 level by the end of the year or early next year, and I don't see any reason to doubt them.
- ux266478 1mo agoBaseline yeah. But part of the reason you run open models is how much nicer fine tuning them is. Granted, you probably don't want to try and make LoRAs on a 4x RTX6000 setup, but you could if you really wanted to and there are other ways to modify models. And yes, if you're good at it, you can turn a piddly mid-range model that's only good at benchmarks into a heavyweight clanker (for a specific domain).
- Aurornis 1mo ago> You can: https://www.exxactcorp.com/Exxact-TS4-149591758-E149591758 https://www.exxactcorp.com/Exxact-TS4-149591758-E149591758 . No, you can get a quote for possibly being allocated one in the distant future. The backlog for these is huge. You cannot buy one any time soon.
- ericd 1mo agoAh gotcha. Have you tried to order something like this in the past?
- arjie 1mo agoI have quoted large nodes from this supplier and have lots of^W^W GPUs from them for personal use. Current lead time is more than 30 months. They're a good provider but you have to be a big shot buying NVL72s before you're getting anything within your payback period.
- ericd 1mo agoAh thanks for the solid info, too bad. I'd seen them come up as a pretty good price for 6000 RTX's in the past, which seem generally pretty available, good source for those?
- arjie 1mo agoYeah, they're good source. But the price for those GPUs is 5 figs even with the nvidia startup program nowadays. Also, I went back and looked. Most of my GPUs are actually from Central Computers who were great, but Exxact is real too. So "lots of" was inaccurate. Also, the lead time I quoted was for individual 8x nodes.
- ericd 1mo agoAh yeah, one of mine is from Central. And yeah, crazy how much they've gone up. But I can see why, they scream.
- arjie 1mo agoOh my god, I completely spaced dude. Weeks, not months. Weeks. Sorry.
- ericd 1mo agoOh, nice haha, way better. And no worries, I'm actually waiting on a quote/timeline from them anyway.
- FireBeyond 1mo agoYeah, you're looking at the scale of ... Nscale ... buying in the order of 1,000 NVL72 racks to get yourself deliveries in a timely manner.