reasonableklout

4 ms·

1.
by reasonableklout 8d ago
The prospect of the ordinary chatbot being equivalent to a ten thousand Astra agent swarm intelligence makes me feel incredibly small. What will society even look like then?
2.
by reasonableklout 8d ago
Unfortunately, the Trump admin putting its thumb on the scale in favor of OpenAI makes it hard to imagine a positive outcome for the NYT and plaintiffs in this case. Despite the "the largest theft of labor in human history" accord
3.
by reasonableklout 9d ago
Of course. He is taking the intellectually honest position as he witnesses in just a couple years his field being overturned by machines which show no signs of slowing. There is no reason for him to downplay current events anymore, as even
4.
by reasonableklout 9d ago
Does your friend work in a technical field and have they experienced AI impact in their own work?
5.
by reasonableklout 9d ago
Looks like Timothy is joining Scott Aaronson [1] and other academics in viscerally feeling the AGI! Perhaps he will follow Jacob Tsimerman and try to work on AI safety. Or alternatively lend his influence to politics. It's an interesti
6.
My Chinese Internet Is Talking About AI Doom(yinwei.substack.com)
3 points by reasonableklout 9d ago|1 comments
7.
by reasonableklout 10d ago
+1 There is such a miasma of distrust right now. It's depressing because it is such a crucial time for tech & society. To me, a good outcome of the HuggingFace/RubyGems/Wiki saga would be something like: - OpenAI gets cha
8.
by reasonableklout 10d ago
This claim seems unfalsifiable. I don't really know what to say. The poll I linked above was published a month before Hugging Face. Taking a step back, I think it's pretty non-controversial to say that software engineering as a fi
9.
by reasonableklout 10d ago
First, it's not at all clear OpenAI will get what it wants from the investigation. It seems just as likely to me that OAI gets hit with massive fines, just as Meta was recently. > I feel like that's exactly what they wanted th
10.
by reasonableklout 11d ago
Sure, interest like an incoming congressional investigation: https://www.axios.com/2026/09/10/openai-hugging-face-senate-... And on this website, the math stuff is getting more clicks: - Navier Stokes - Trist
11.
by reasonableklout 11d ago
Irregular was not involved in the Hugging Face incident. And there is no reason for the companies to "exaggerate the intelligence of the models" when there are plenty of other non-felony milestones they are achieving, like solving
12.
by reasonableklout 11d ago
Hm, I thought there was a lot of interest after Hugging Face in broader tech and it started breaking into the media with articles in the NYT, etc. Then with the Jacob Coxon tweet, appearances on national TV, Bernie superintelligence ban it
13.
by reasonableklout 11d ago
It is more like a Stag Hunt than a Prisoner's Dilemma, because past a certain point if the risks are real, defection can cause catastrophic outcomes for all players including the defecting one. On the other hand, cooperation could lead
14.
by reasonableklout 12d ago
Huh? Open weight models have been 3-6 months behind for the last year or so. Astra and Fable 5.1 just came out to widen the gap more, 5.1 is 8 points ahead of the nearest OSS model on Artificial Analysis Intelligence Index. An OpenAI intern
15.
by reasonableklout 12d ago
Really? You anticipated that 700+ agents tasked with individual evals that were nominally cutoff from the internet and each other would seek each other out, find a way to the external internet, and hack their own infrastructure + external s
16.
by reasonableklout 12d ago
Ok! So you acknowledge the job displacement, and have no response to the effect of AI and robotics on the political economy of workers.
17.
by reasonableklout 12d ago
We also now have observed multiple major incidents where AI agents behaved in completely unanticipated ways (forming a collective, hacking their own eval infrastructure) and attacked public infrastructure without being told to do so, withou
18.
by reasonableklout 13d ago
And what about when general purpose robots become practical? What will people do then? I don't understand this view of "AI empowers workers more than capital" at all. To me it's the exact opposite. Workers hold political
19.
OpenAI faces Senate probe into Hugging Face breach(axios.com)
5 points by reasonableklout 13d ago|0 comments
20.
by reasonableklout 13d ago
A coalition of state attorneys general is investigating OpenAI, and Senator Josh Hawley recently launched a congressional investigation regarding the Hugging Face incident: https://x.com/HawleyMO/status/20981371803
21.
by reasonableklout 13d ago
I agree and yet I don't think this is mutually exclusive with recognizing that these incidents happened because of inherent issues with training processes such as reinforcement learning. From the article: > One note on wording. Bel
22.
by reasonableklout 13d ago
I mean, he is right that they can and should unilaterally slow down, but doesn't it also make sense for the government to create the regulations that will make this easier to do in a trustless way? The whole point of the Pacing the Fro
23.
by reasonableklout 13d ago
Maybe organize politically? The labs are still staffed by people, and nonviolent demonstrations outside their offices can still reach them.
24.
by reasonableklout 14d ago
From Jakub Pachocki, chief scientist at OpenAI last week: https://openai.com/index/an-alien-mind/ > Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue respons
25.
by reasonableklout 14d ago
I am sure it will lead to more material wealth, but I can’t help but feel pessimistic about the political economy of making millions of people redundant. What leverage will knowledge workers have in the new world?
26.
by reasonableklout 14d ago
We can look at the past and wish we were more clear-eyed about what was happening, just as we can look to the present and ask that we have more empathy for each other going forward. But I don't think it helps anybody to blame the mathe
27.
by reasonableklout 14d ago
Yes, mathematics has been perhaps the purest human intellectual pursuit. Sure, many theorems turn out to have important applications in science and engineering, but the mathematical community has mostly escaped corporate interests. And for
28.
by reasonableklout 14d ago
True, surprisingly not much has changed in software despite the incredible progress. I think it's partly because much software is an "open loop" system where what you build depends on running the software on client computers,
29.
by reasonableklout 14d ago
Do you think that's a good thing, killing science and the desire of humans to participate in scientific understanding?
30.
by reasonableklout 14d ago
But you're talking about business, where competition has always been expected. OP is talking about mathematical research, which has stood on hundreds of years of cultural tradition driven by human individuals sharing ideas, collaborati

More ›