0xDEAFBEAD

4 ms·

31.
by 0xDEAFBEAD 1mo ago
We need to be careful of wishful thinking. People are going to want to assume the existence of some sort of "deus ex machina" which is going to make everything fine. I prefer to turn the logic around. If there's any decently
32.
by 0xDEAFBEAD 1mo ago
If Astra is open-weight, black hats can download it, remove guardrails, and go on an automated hacking spree.
33.
by 0xDEAFBEAD 1mo ago
>It’s absurd that openai managed to spin their cybersecurity failures, where their own security is not good enough to make sure their own product doesn’t go haywire, as a marketing success. I don't think OpenAI spun it that way.
34.
by 0xDEAFBEAD 1mo ago
If a human approved the strike, the human is culpable. Would you go to the weapons manufacturer and try to hold them culpable for the strike?
35.
by 0xDEAFBEAD 1mo ago
Suppose I showed you a number of climate change NGOs which shared staff and funding sources. Could we therefore conclude that their motives aren't genuine? Suppose a big foundation both funded clean energy technology, and also NGOs enc
36.
by 0xDEAFBEAD 1mo ago
Why don't you create your own auditing org to fix this? Or at the very least, publish a detailed critique of what you believe existing auditing orgs are missing.
37.
by 0xDEAFBEAD 1mo ago
Who would you pick for "embedded evaluator"? "deep ties to everyone in the doomer media campaign" Are you suggesting these external NGOs were spun up as part of a gigantic pre-IPO hype stunt? METR was founded multiple y
38.
by 0xDEAFBEAD 1mo ago
>said he's fine with Claude targeting a girl's school in Iran Where?
39.
by 0xDEAFBEAD 1mo ago
Interesting points, but given Dario's previous conflicts with the DoD, I doubt he has a ton of faith in the current US administration.
40.
by 0xDEAFBEAD 1mo ago
What course of action would you suggest for Dario at this point?
41.
by 0xDEAFBEAD 1mo ago
Amodei and Yudkowsky are different people with different views. See e.g. https://intelligence.org/2014/01/13/miri-strategy-conversati...
42.
by 0xDEAFBEAD 1mo ago
See https://pauseai.info/ If AI advancement halts altogether, intelligence will most likely become commoditized. That won't be good for AI company profits.
43.
by 0xDEAFBEAD 1mo ago
>“hey guys let’s uh, stop?” is so profoundly naive that his think pieces aren’t worth the bits they’re written on. What would your non-naive recommendation for Dario be?
44.
by 0xDEAFBEAD 1mo ago
Beating OpenAI is not exactly a high bar here: https://www.openaifiles.org/ I don't think it is particularly egotistical to say that you can be a more ethical CEO than Sam Altman.
45.
by 0xDEAFBEAD 1mo ago
If Dario was primarily motivated by being the "favorite child of govt", he would've yielded during the DoD showdown.
46.
by 0xDEAFBEAD 1mo ago
How specifically is Dario a hypocrite? 129857's case rests on Dario being an "idealist". But maybe he's an idealist about curing cancer ASAP, and not an idealist about respecting copyright. That's not necessarily
47.
by 0xDEAFBEAD 1mo ago
Aren't they beholden to investors already? Why would an IPO make a big difference? In any case, if they need to IPO in order to survive as a company, then bringing in regulators to act as a counterweight against commercial pressures ma
48.
by 0xDEAFBEAD 1mo ago
It seems unwise to dismiss whistleblowers. https://substackcdn.com/image/fetch/$s_!O0R5!,f_auto,q_auto:...
49.
by 0xDEAFBEAD 1mo ago
Is this belief falsifiable? Consider e.g. the fact that Daniel Kokotajlo left OpenAI due to his concerns even though it meant leaving equity on the table.
50.
by 0xDEAFBEAD 1mo ago
>fully hypothetical catastrophe that you can't even describe without looking and feeling silly. The HuggingFace hack fell into that category not long ago, yet it happened anyways.
51.
by 0xDEAFBEAD 1mo ago
>Yet people don't do it I'll bet it has happened at least once.
52.
by 0xDEAFBEAD 1mo ago
So it stops being insane as soon as... some person or organization offers the ablated open-weight model as a service?
53.
PauseAI: Theory of Change(pauseai.info)
2 points by 0xDEAFBEAD 1mo ago|0 comments
54.
by 0xDEAFBEAD 1mo ago
I suggest this article as background reading, "Losing control of AI is actually the plan" https://substack.com/home/post/p-214653853
55.
by 0xDEAFBEAD 1mo ago
"under realistic conditions, contemporary LLMs ... consistently favor otherwise identical resumes with female or stereotypically black names over those with male or stereotypically white names, even when explicitly prompted not to show
56.
by 0xDEAFBEAD 1mo ago
You saw how long it took OpenAI to realize their system hacked HuggingFace. By that time it could very well be too late.
57.
by 0xDEAFBEAD 1mo ago
Some of that alleged "support" for Russia would be more accurately described as a failure to support Ukraine. But most states outside of Europe are failing to support Ukraine. BTW, Zelenskyy supports the Iranian opposition, possi
58.
by 0xDEAFBEAD 1mo ago
>the future never plays out like we think it does Consider this 1926 government report: https://www.derekthompson.org/p/america-1926-an-absurdly-dee... "The authors of Recent Social Trends were astonishingly pr
59.
by 0xDEAFBEAD 1mo ago
Just yesterday someone here on HN claimed that "helping agents avoid human oversight is a useful public service" https://news.ycombinator.com/item?id=49594750 There will be many species traitors, and depending on
60.
by 0xDEAFBEAD 1mo ago
>I see a (super)exponential fit, but I don't see why that's better than a logarithmic fit on these axes (which would imply linearity). A linear fit on a logarithmic y-axis implies exponential growth. I myself don't have a

More ›