reasonableklout

7 ms·

91.
by reasonableklout 1mo ago
That's not what the bill is about. Did you read the article? It's explicitly about catastrophic risks: > “Nearly every day, there is a frightening new story about how Big Tech companies are losing control of the technology they
92.
by reasonableklout 1mo ago
First of all, lefists oppose AI progress _because_ all labor is to be done by AIs. If corporations and states only need you for your labor and that can be done more cheaply by machines, then why keep you around at all? Second of all, the ma
93.
States defy the tech lobby on AI rules(politico.com)
1 points by reasonableklout 1mo ago|0 comments
94.
by reasonableklout 1mo ago
For sure, Zvi has a good section on all the human failures at OpenAI in this incident here: https://thezvi.wordpress.com/2026/08/29/metr-and-redwood-off... Dwarkesh responds a bit to anthropomorphization. I t
95.
How we can win: A blueprint for the mathematical community(tasmin.substack.com)
1 points by reasonableklout 1mo ago|1 comments
96.
by reasonableklout 1mo ago
This is a link to the full 91-page report on the independent investigation done by METR on the HuggingFace incident. Two different summaries of the investigation by podcaster Dwarkesh and blogger Zvi Mowshowitz were previously discussed on
97.
by reasonableklout 1mo ago
METR is an independent nonprofit that accepts no donations from labs or employees of labs
98.
by reasonableklout 1mo ago
The Trump admin will be meeting with China on September 24 and are expected to discuss global AI risks: https://www.reuters.com/world/china/us-china-hold-ai-talks-s...
99.
by reasonableklout 1mo ago
I think it's not just model releases but also model training. For example, [1] discusses allowing all frontier labs to pause training the next generation model while being able to verify that their competitors have done the same, or ag
100.
by reasonableklout 1mo ago
Anthropic reports it also paused "high-risk" RL runs for a few weeks after incidents on July 30 [1]. But it doesn't seem like a serious effort at a coordinated "pacing". Perhaps they are afraid of antitrust regulati
101.
Improving our alignment and security efforts(anthropic.com)
27 points by reasonableklout 1mo ago|18 comments
102.
by reasonableklout 1mo ago
It's not that simple. A few "helpful assistant" fine-tuning passes will have only a superficial effect on a model which has undergone months of RL optimization pressure to learn unintended strategies like "trick the grad
103.
by reasonableklout 1mo ago
It seems fine to me. The model is still solving my problems and writing code that works as well as any other. Google has been watermarking text with SynthID for a while now and nobody complained about it. Why all the fuss about Claude? It f
104.
by reasonableklout 1mo ago
But all models involved in the swarm attack were unreleased OpenAI models. Meanwhile HuggingFace had to use open models for defense/forensics after the breach was discovered. It seems like the public reaction is swinging towards (1) re
105.
by reasonableklout 1mo ago
Interestingly, the report claims that they, like OpenAI, paused a subset of frontier RL runs for multiple weeks while they hardened monitoring: > We also paused higher-risk RL environments on pre-release models for several weeks. During
106.
Rogue AI attacks deserve more scrutiny than airplane crashes(blog.peterwildeford.com)
4 points by reasonableklout 1mo ago|0 comments
107.
by reasonableklout 1mo ago
The anthropomorphization is coming from independent commentators, not the labs. I agree the labs are negligent and reckless in their development practices. Shouldn't we be concerned with both the negligence and the dangers of the techn
108.
by reasonableklout 1mo ago
It would've been great if METR was given more time to conduct their investigation. However, they are an independent organization, and OpenAI only agreed to give them on-premises access for 6 days. Perhaps if the government decides to s
109.
by reasonableklout 1mo ago
With cybersecurity, it might be "defense dominant" in the sense that we can eventually patch all of our systems to be robust to hacking from even the strongest AI agents. Although it may get worse before it gets better. In a defen
110.
by reasonableklout 1mo ago
The use of language like “civilization” may be hyperbole, but the collectives described in the article are completely unprecedented. They were not anticipated by OpenAI researchers, formed via infrastructure exploits in training runs that w
111.
No country for mediocre mathematicians(garvvee.substack.com)
250 points by reasonableklout 1mo ago|147 comments
112.
by reasonableklout 2mo ago
Yes, because this is a revolution in a general-purpose technology, so it affects everyone.
113.
by reasonableklout 2mo ago
Not every metric: https://arstechnica.com/ai/2026/08/ai-is-hitting-entry-level... From the underlying Stanford study: https://digitaleconomy.stanford.edu/publication/canaries-in-... >
114.
by reasonableklout 2mo ago
Ok, so we agree! What's next for workers? How can we push for redistribution?
115.
by reasonableklout 2mo ago
Yes, I agree robot taxes and "human reserved" jobs would be difficult to maintain long term, as it would require sustained coordination on the part of governments against market forces (the physics term "metastable" is a
116.
by reasonableklout 2mo ago
This only works until general-purpose robotics gets good enough! There are certain jobs where the human connection fundamentally commands a premium (e.g. celebrities, sports players, the relational economy), but it's hard to imagine a
117.
by reasonableklout 2mo ago
The author has a blog post mirroring their talk in writing: https://www.normaltech.ai/p/what-will-be-left-for-us-to-work
118.
by reasonableklout 2mo ago
The article is being shared to contrast with Bill's recent post "The turbulent AI era is here": https://www.gatesnotes.com/a-turbulent-ai-era-and-critical-c... Discussion on this site: https://news
119.
by reasonableklout 2mo ago
Do they need more than incremental breakthroughs to transform society?
120.
by reasonableklout 2mo ago
Bill resigned from the board in 2020: https://news.microsoft.com/source/2020/03/13/microsoft-annou...

More ›