3 ms·

How could Trump ban tiktok then? And Fable for that matter. Maybe you're somehow legally allowed to distribute and download the weights, but most of us can't r

How could Trump ban tiktok then? And Fable for that matter. Maybe you're somehow legally allowed to distribute and download the weights, but most of us can't run GLM 5.2 at home.

verdverm 4mo ago
You won't need a frontier size model for most tasks before long. Qwen 3.6 (small) punches way above its weight. I run it at home @8bit on an OEM Spark
- dualvariable 4mo ago
  And corporations could run DeepSeek models on cloud hardware.
  - verdverm 4mo ago
    You can run most open models on cloud hardware. Google Cloud gives you a click to deploy, but then you have saturation / ROI considerations, versus Google serving them up multi-tenant, per-token.
    - dualvariable 4mo ago
      For ROI though you can run 24/7 agentic-style workloads, constantly churning through all your source code looking for security bugs (or whatever) and you DONT pay per-token costs. A DeepSeek instance running 24/7 in a cloud provider will beat doing that with Claude which could bankrupt you with 100x more costs, even though it might find more. And DeepSeek may find enough to keep your engineering team saturated and busy fixing things.
      - verdverm 4mo ago
        This process works better with multiple models and not simply slinging Ai at it 24/7. It's not an ROI just because you keep the GPU busy. The signal to noise ratio is not there yet
- kappar 4mo ago
  Second this, I am also running qwen 3.6 35b Q8 on a 5090 liquid getting around 250 tokens / second and it is plenty capable. I actually haven't even looked at models recently because I am happy with what I have. And.. now I feel the need to look again. Darn, there goes my afternoon
wqaatwt 4mo ago
They “banned” the company, not the product. US government could ban US citizens from buying tokens from certain Chinese provider but there is no precedent for banning the usage of specific software if you run it yourself.
- hdgvhicv 4mo ago
  Decss

How could Trump ban tiktok then? And Fable for that matter. Maybe you're somehow legally allowed to distribute and download the weights, but most of us can't run GLM 5.2 at home.

verdverm 4mo ago

You won't need a frontier size model for most tasks before long. Qwen 3.6 (small) punches way above its weight. I run it at home @8bit on an OEM Spark

dualvariable 4mo ago
And corporations could run DeepSeek models on cloud hardware.
- verdverm 4mo ago
  You can run most open models on cloud hardware. Google Cloud gives you a click to deploy, but then you have saturation / ROI considerations, versus Google serving them up multi-tenant, per-token.
  - dualvariable 4mo ago
    For ROI though you can run 24/7 agentic-style workloads, constantly churning through all your source code looking for security bugs (or whatever) and you DONT pay per-token costs. A DeepSeek instance running 24/7 in a cloud provider will beat doing that with Claude which could bankrupt you with 100x more costs, even though it might find more. And DeepSeek may find enough to keep your engineering team saturated and busy fixing things.
    - verdverm 4mo ago
      This process works better with multiple models and not simply slinging Ai at it 24/7. It's not an ROI just because you keep the GPU busy. The signal to noise ratio is not there yet
kappar 4mo ago
Second this, I am also running qwen 3.6 35b Q8 on a 5090 liquid getting around 250 tokens / second and it is plenty capable. I actually haven't even looked at models recently because I am happy with what I have. And.. now I feel the need to look again. Darn, there goes my afternoon

wqaatwt 4mo ago

They “banned” the company, not the product. US government could ban US citizens from buying tokens from certain Chinese provider but there is no precedent for banning the usage of specific software if you run it yourself.

hdgvhicv 4mo ago
Decss