4 ms·

They will if it becomes a political issue that causes regulation, which is looking likely.

andsoitis 1mo ago
Geopolitics gets in the way. It is a race between America and China. There's no way to know what is "safe enough", so you might as well go as fast as technology will allow, and be on the watch out for negative things you can predict specifically and then adapt so as to minimize net negatives.
- ajam1507 1mo ago
  It doesn't have to be a race, that's just the way we have been treating it so far. There have been examples in the past of civilization ending technology that has been redirected from being a death race (chemical, biological, and nuclear arms in particular.)
  - TFNA 1mo ago
    China doesn't regard AI as a death race. It regards it as a way to ensure its own global stature and benefit its own population.
    - deleted 1mo ago
      [deleted]
    - mofeien 1mo ago
      China has stricter regulations on models than the US. For example you can't release a model if the hallucination rate is above a certain threshold. The US hasn't fully woken up to the fact yet that the race to superintelligence is a death race. China (population, members of the government, academics, lab employees) could also just not have fully grasped it yet. I'm personally confident that it will be possible to explain it to them.
      - rudolftheone 1mo ago
        > China has stricter regulations on models than the US. For example you can't release a model if the hallucination rate is above a certain threshold. I wasn't aware of that, so I checked - and indeed, there are some firm regulations there, just not exactly the one you're describing: - a new generative AI must pass a security assessment and be filed with the "Cyberspace Administration of China" before launch, tested against GB/T 45654-2025, which has hard numeric thresholds: training corpus ≥96% compliant on manual inspection (≥98% technical), sources with >5% illegal/harmful content can't be collected at all, generated content ≥90% pass rate, ≥95% refusal on questions that must be refused, ≤5% false refusals. The moment in which hallucination factors into this hard 90% threshold is Risk A.5.a ("inaccurate content grossly inconsistent with scientific knowledge"). The standard explicitly states however, that this risk applies when the model is used for specific service types with higher safety requirements, such as critical information infrastructure, automatic control, medical information services, psychological counseling, and financial information services. Everywhere else, accuracy is a best-effort obligation. source: https://cset.georgetown.edu/publication/china-gen-ai-safety-standard-final/ https://cset.georgetown.edu/publication/china-gen-ai-safety-...
    - andsoitis 1mo ago
      > China doesn't regard AI as a death race. It regards it as a way to ensure its own global stature and benefit its own population. I'm curious about where you get this information from? I'd love to get links to some (Chinese) articles that paint this picture, if you have them.
  - bananamogul 1mo ago
    Not sure nuclear arms is a great example. There are more countries with nuclear weapons now than in 1970. India, Pakistan, and North Korea have all joined the nuclear club since then. The SALT and START treaties are no longer in effect. Perhaps CFCs (Montreal Treaty) is a better example of international cooperation to solve a potential extinction-level event, though it was never a "race" in the same sense.
  - keeshond 1mo ago
    even if both sides agree to a pause china will annihilate the us in the robotics race (for which there will be no slowdown). software/llms is america's only edge
- goatlover 1mo ago
  The AI race is caused and being sustained by American tech companies. China is an excuse to keep it going.
- deepwoods 1mo ago
  Granted I can only read English, but I find that I constantly see this take from Americans and I have never seen anything to suggest that developers and tech leaders in China actually feel this way. But just based on the models that come out, it seems like the Chinese labs - which, funny enough, are less monolithic than the two-man race in the US where the two giants seem to trade personnel regularly - are trying to make smaller, more efficient models rather than building a machine god. To the extent there is an intentional geopolitical angle to this at all, it seems like the US is banking on landing one massive punch - developing a superintelligence and then using it to dominate the world - while China is attempting to sabotage the assumptions that make a superintelligence economically viable. I am curious what it would look like if the shoe was on the other foot, though. If China had the lead, and Qwen 4 was an Astra class model and the best US model was only as good as Kimi K3, would US commentators call it AGI?
paimapi 1mo ago
if it's a political issue then this is just Sam telling people to do one thing while still riding his SVPs and other leads hard on roadmaps, 'boldness', and delivery metrics which is to say - unlikely for it to materially slow, only a lot of chirping about slowing down to the public with a couple outlier examples of 'slowing down' they can show publicly

Geopolitics gets in the way. It is a race between America and China. There's no way to know what is "safe enough", so you might as well go as fast as technology will allow, and be on the watch out for negative things you can predict specifically and then adapt so as to minimize net negatives.

ajam1507 1mo ago
It doesn't have to be a race, that's just the way we have been treating it so far. There have been examples in the past of civilization ending technology that has been redirected from being a death race (chemical, biological, and nuclear arms in particular.)
- TFNA 1mo ago
  China doesn't regard AI as a death race. It regards it as a way to ensure its own global stature and benefit its own population.
  - deleted 1mo ago
    [deleted]
  - mofeien 1mo ago
    China has stricter regulations on models than the US. For example you can't release a model if the hallucination rate is above a certain threshold. The US hasn't fully woken up to the fact yet that the race to superintelligence is a death race. China (population, members of the government, academics, lab employees) could also just not have fully grasped it yet. I'm personally confident that it will be possible to explain it to them.
    - rudolftheone 1mo ago
      > China has stricter regulations on models than the US. For example you can't release a model if the hallucination rate is above a certain threshold. I wasn't aware of that, so I checked - and indeed, there are some firm regulations there, just not exactly the one you're describing: - a new generative AI must pass a security assessment and be filed with the "Cyberspace Administration of China" before launch, tested against GB/T 45654-2025, which has hard numeric thresholds: training corpus ≥96% compliant on manual inspection (≥98% technical), sources with >5% illegal/harmful content can't be collected at all, generated content ≥90% pass rate, ≥95% refusal on questions that must be refused, ≤5% false refusals. The moment in which hallucination factors into this hard 90% threshold is Risk A.5.a ("inaccurate content grossly inconsistent with scientific knowledge"). The standard explicitly states however, that this risk applies when the model is used for specific service types with higher safety requirements, such as critical information infrastructure, automatic control, medical information services, psychological counseling, and financial information services. Everywhere else, accuracy is a best-effort obligation. source: https://cset.georgetown.edu/publication/china-gen-ai-safety-standard-final/ https://cset.georgetown.edu/publication/china-gen-ai-safety-...
  - andsoitis 1mo ago
    > China doesn't regard AI as a death race. It regards it as a way to ensure its own global stature and benefit its own population. I'm curious about where you get this information from? I'd love to get links to some (Chinese) articles that paint this picture, if you have them.
- bananamogul 1mo ago
  Not sure nuclear arms is a great example. There are more countries with nuclear weapons now than in 1970. India, Pakistan, and North Korea have all joined the nuclear club since then. The SALT and START treaties are no longer in effect. Perhaps CFCs (Montreal Treaty) is a better example of international cooperation to solve a potential extinction-level event, though it was never a "race" in the same sense.
- keeshond 1mo ago
  even if both sides agree to a pause china will annihilate the us in the robotics race (for which there will be no slowdown). software/llms is america's only edge
goatlover 1mo ago
The AI race is caused and being sustained by American tech companies. China is an excuse to keep it going.
deepwoods 1mo ago
Granted I can only read English, but I find that I constantly see this take from Americans and I have never seen anything to suggest that developers and tech leaders in China actually feel this way. But just based on the models that come out, it seems like the Chinese labs - which, funny enough, are less monolithic than the two-man race in the US where the two giants seem to trade personnel regularly - are trying to make smaller, more efficient models rather than building a machine god. To the extent there is an intentional geopolitical angle to this at all, it seems like the US is banking on landing one massive punch - developing a superintelligence and then using it to dominate the world - while China is attempting to sabotage the assumptions that make a superintelligence economically viable. I am curious what it would look like if the shoe was on the other foot, though. If China had the lead, and Qwen 4 was an Astra class model and the best US model was only as good as Kimi K3, would US commentators call it AGI?

paimapi 1mo ago

if it's a political issue then this is just Sam telling people to do one thing while still riding his SVPs and other leads hard on roadmaps, 'boldness', and delivery metrics which is to say - unlikely for it to materially slow, only a lot of chirping about slowing down to the public with a couple outlier examples of 'slowing down' they can show publicly