5 ms·
Are these models still relevant for people outside the US? I get the impression we're stuck on GPT 5.5 and Opus 4.8 pretty much permanently now, and relying on
by pixelpoet 4mo ago
Are these models still relevant for people outside the US? I get the impression we're stuck on GPT 5.5 and Opus 4.8 pretty much permanently now, and relying on Chinese models in future.
- seviu 4mo agoDont worry, chinese models will distill frontier ones, quite fast. The excuse they give is borderline childish. I get the thing about slow rollout, make sure partners get to fix the bugs, etc... But bad actors are hard working motivated entities with tens of thousand of fake ids, and american citizens working for them, for pennies. All while the ones like or you sit at a crossfire which is borderline useless. I cant wait to see what Qwen did with the massive distillation they made out of Opus 4.8 and Fable aka Mythos aka pretty sure they jailbroke it.
- 15155 4mo agoThis is nothing a few felony indictments can't fix.
- bloppe 4mo agoPretty sure Chinese police will not cooperate with a US indictment
- 15155 4mo agoNo, but the Americans facilitating their access sure as hell will.
- Sammi 4mo agoYou'll need to make all US customers provide personal IDs for access first. I'm not American, but I do often hear how attached Americans can be to their personal firearms and how against providing their personal ID they can be.
- cmrdporcupine 4mo agoAnybody who used codex or claude for the last few months is sitting on directories full of session logs that -- with the right motivation and effort -- can be massages and used for fine tuning or reinforcement training on any large model.
- SyneRyder 4mo agoNot only that, but using Opus 4.8 [1m] right now outside the US, and suddenly I only have a 500k context window. I really hope this is just a strange Claude Code bug, but I had access to a 1 Million window before, and it wouldn't entirely surprise me if context window length becomes another US export restriction. The Anthropic page here seems to say that Max users should have access to the full 1 Million window for 4.8: https://support.claude.com/en/articles/8606394-how-large-is-the-context-window-on-paid-claude-plans https://support.claude.com/en/articles/8606394-how-large-is-... I was already setting up my infra to experiment with GLM 5.2 and its 1 Million token window before this happened. I think I'm glad I did. EDIT: Found a solution, seems Claude Code 2.1.193 (or an earlier version I didn't notice) changed default settings, so that if you have Autocompact turned on it occurs at 50% of the context window. If you turn off Autocompact, the full 1 Million context window is restored. Another example of Claude Code quietly changing default settings sigh
- vorticalbox 4mo agoYou want to compact early though as sending the whole chat you will end up with a lot of tokens not in the cache which 1. Costs way more and 2. Will slow the request down as it has to process it all.
- SyneRyder 4mo agoI do agree in cases where I'm using API and not the subscription, this would be very costly via API. Not sure why the tokens wouldn't be in the cache though? Seems everything should be cached as long as I'm within the 1 hour caching window? If I'm wrong about how token caching works, I'm eager to learn! My other concern is, it isn't really a 1 Million context window if we can only use the first 500k, right? But now that I've found that I can re-enable it, I'm happy. I've previously had sessions go to 700k tokens and still be okay, though it does start drifting at that 700k point. I'm regularly at 300k with no problem.
- sajithdilshan 4mo agoThat’s assuming China would not start controlling the access to their models.
- deleted 4mo ago[deleted]
- hgoel 4mo agoChina has no reason to do that. The US is freely handing them the international market for AI.
- sajithdilshan 4mo agoAre they though? I see this as a precautious method by US to maintain AI model superiority so the Chinese companies cannot distill from the US frontier models. Let's see how fast Chinese models would improve without access to latest US models and if they keep on releasing open models
- deleted 4mo ago[deleted]
- Daishiman 4mo ago> Let's see how fast Chinese models would improve without access to latest US models and if they keep on releasing open models Chinese tech has been on an exponential growth trajectory. If they see the need for AI superiority then there's really no moat for AI companies.
- sajithdilshan 4mo agoThey do see the importance of AI superiority. The whole modern infrastructure as well as national security relies on AI superiority. Imagine a system smart enough to find vulnerabilities and get into any system that’s connected to internet. Which country wouldn’t want to have it
- deleted 4mo ago
- Sol- 4mo agoIf the US really cracks down on frontier model access, you'll see them make Chinese open models illegal. You might say "oh well, let them try", but they will just put direct and secondary sanctions on every company whose systems have used Chinese models in some way. They just have to make an example out of a few international companies and no one will dare to use Chinese frontier models, at least commercially.
- AlecSchueler 4mo agoThis is why we can't decouple ourselves from the US fast enough.
- epolanski 4mo agoNobody is going to care in Europe but a handful of big corps with huge us contracts. And good luck proving it.
- tokioyoyo 4mo agoTheoretically that gives edge to all other companied around the world though, no?
- Sol- 4mo agoI don't think a critical mass of them will oppose the US. The most likely equilibrium is Chinese models being shut out of any US-aligned markets (i.e. Europe at the very least, also East Asia, etc.). Probably India, Russia, Brazil etc. will resist such pressure, but they are protectionist and resilient to trade wars anyway, at the expense of their own welfare of course.
- lukeinator42 4mo agoJust because the US sanctions a country, doesn't mean the rest of the world needs to as well. As a Canadian we traded with Cuba even when the US had an embargo on them.
- 4mo ago
- surgical_fire 4mo agoHopefully. I hope this eventually nudges my employer to use Deepseek or other Chinese models.
- cryo32 4mo agoYou shouldn’t build a business that relies on any of these models. It’s a geopolitical and sovereignty risk now. Someone could just rug pull your entire stack.