4 ms·
Buying four $13000 GPUs and several thousand dollars worth of supporting hardware seems crazy Especially when you realize you really want 8 of them. But... Y
by CamperBob2 4mo ago
Buying four $13000 GPUs and several thousand dollars worth of supporting hardware seems crazy
Especially when you realize you really want 8 of them. But...
You're not running a model that's equal to what you get when you buy GLM tokens from Z.ai.
... to be perfectly clear: you have no earthly idea what you're getting when you buy GLM tokens from Z.ai. Your options are to run locally, rent cloud hardware, or hope for the best.
- SwellJoe 4mo agoOK, that's true, too, but they have a vested interest in GLM being as good as possible. They're nipping at the heels of the big guys, they don't want to ruin that by hobbling their best model with a lossy quantization.