4 ms·
Go free stuff! But... no one is running 400B models on their computers. You are just giving them data instead. Its not like China is known to protect IP. Your
by PlatoIsADisease 7mo ago
Go free stuff! But... no one is running 400B models on their computers.
You are just giving them data instead. Its not like China is known to protect IP. Your data is going to be used against you, and we cant use western laws to keep it safe.
- impulser_ 7mo agoYeah they do. https://openrouter.ai/minimax/minimax-m2.5/providers https://openrouter.ai/minimax/minimax-m2.5/providers https://openrouter.ai/z-ai/glm-5/providers https://openrouter.ai/z-ai/glm-5/providers https://openrouter.ai/moonshotai/kimi-k2.5/providers https://openrouter.ai/moonshotai/kimi-k2.5/providers
- PlatoIsADisease 7mo agoThis is not 'running it on our own computers'. But I like the option to give my data to a rando rather than one of the big 5 US companies that can get sued. At least the rando probably has no idea what to do with 10M of my customer's IP. Actually... thank you for the links. Unironically.
- SlavikCA 7mo agoSo, only Americans can use data against others? By the way, I'm running 400B model on my computer with 72GB VRAM: Qwen3.5-397B-A17B-GGUF/UD-Q4_K_XL getting 13 t/s. Subjectively, I feel it's runs at the level of Anthropic Claude, just slower.
- PlatoIsADisease 7mo agoQuestion for you, that 13t/s, is that pretty solid even with high context/tokens? I know Apple marketing says 'look at our 20t/s' but they sent less than 40 tokens.
- Aerroon 7mo ago256 GB of RAM?
- selfhoster11 7mo agoIt doesn't take much hardware. I have run larger models.
- bigyabai 7mo ago> we cant use western laws to keep it safe Western laws didn't stop OpenAI from leaking PII, or Nest from getting hacked. I'll take my chances with the CCP.