khafra

8 ms·

61.
by khafra 8mo ago
Amazon will be happy to sell you a less impressive, but also less "rare historical artifact" microwave browning dish for $20 or so.
62.
by khafra 8mo ago
I guess today's kids don't know this; but "Unsafe at Any Speed" was the title of a 1965 book that spurred the creation of the Department of Transportation, and changed the automotive industry. The point is that, if you&#
63.
by khafra 8mo ago
It told him "this is what our religion says we should do" without any kind of weird prompting, role-playing, or persona-shifting beyond using a different language. As a westerner, you may regard athiests with suspicion, or even
64.
by khafra 8mo ago
Rice's Theorem says you cannot predict or control the effects of nearly any program on your computer; for example, there's no way to guarantee that running a web browser on arbitrary input will not empty your bank account and dona
65.
by khafra 8mo ago
Cordwainer Smith's style and subject matter is quite different from Watts; I felt this story was like a combination of the two. So, if you would like this story even if it was less eschatalogically cynical, and had more of a golden ag
66.
by khafra 8mo ago
They're the last living humans, and the last human-derived mind? I like Cordwainer Smith and Peter Watts; so I really liked this blend of their styles and subjects.
67.
by khafra 8mo ago
> undo market influence Pointless nitpick, but you want "undue market influence." "Undo market influence" is what the FTC orders when they decide there's monopolistic practices going on.
68.
by khafra 9mo ago
> Non-trivial coding tasks A coding agent just beat every human in the AtCoder Heuristic optimization contest. It also beat the solution that the production team for the contest put together. https://sakana.ai/ahc058&#x2
69.
by khafra 10mo ago
LLMs are an especially tough case, because the field of AI had to spend sixty years telling people that real AI was nothing like what you saw in the comics and movies; and now we have real AI that presents pretty much exactly like what you
70.
by khafra 10mo ago
You can't anonymize comments from well-known users, to an LLM: https://gwern.net/doc/statistics/stylometry/truesight/index
71.
by khafra 10mo ago
The natural solution is futarchy: Vote on values, bet on beliefs. Everybody knows that, all else being equal, they want higher GDP/cap, better GINI, a higher happiness index. Only the experts know whether tariffs will help produce this
72.
by khafra 10mo ago
If you start out as a non-profit, and pull a bunch of shady shenanigans in order to convert to a for-profit, claiming to be ethical after that is a bit of a hard sell.
73.
by khafra 10mo ago
This piece is wildly optimistic about the outcomes likely from AI on par with the smartest humans, let alone smarter than that. The author seems to think that widespread disbelief in the legitimacy of the system could make a difference, in
74.
by khafra 11mo ago
All of the leading labs are on track to kill everyone, even Anthropic. Unlike the other labs, Anthropic takes reasonable precautions, and strives for reasonable transparency when it doesn't conflict with their precautions; which is who
75.
by khafra 11mo ago
Shared-keyboard OMF 2097 also had an overwhelming advantage for the first mover, since most keyboards had 2-3 key rollover--if you hit wd to jump forward, your opponent had to be fast to do anything before you hit your attack key.
76.
by khafra 11mo ago
Your free advice is well-taken and apropos in 2015 and before. The major point of the essay is that junior builders--e.g., people doing tasks that are standardized and understood well enough to automate--no longer get hired. Either we get a
77.
by khafra 11mo ago
Seems like the hope, for OOD workers, is that matching weird employer needs with weird employee capabilities is a belly-of-the-curve problem that's about to get automated away.
78.
by khafra 11mo ago
Thanks to modern technology, every advertised job opening now gets > 1 million resume submissions a year, no matter the size of the company.
79.
by khafra 11mo ago
Math is a verifiable domain. Translate a proof into Lean and you can check it in a non-hallucination-vulnerable way.
80.
by khafra 11mo ago
Note that model sycophancy is caused by RLHF. In other words: Imagine taking a human in his formative years, and spending several subjective years rewarding him for sycophantic behavior and punishing him for candid, well-calibrated response
81.
by khafra 11mo ago
"Consciousness" as in subjective experience, whatever it is we mean by "the hard problem," is very much in doubt. But "self-awareness," as in the ability to explicitly describe implicit, inner cognitive process
82.
by khafra 11mo ago
> Generalizing your experience to everyone else's betrays a lack of imagination. One guy is generalizing from "they don't work for me" to "they don't work for anyone." The other one is saying "they
83.
by khafra 1y ago
We'd want to do what we should be doing anyway--put a few trillion dollars, and all the scientific prestige we can muster, into solving ASI alignment; and then into building ASI. The local aliens that we're just beginning to get t
84.
by khafra 1y ago
By "we should be devoting substantial resources to finding solutions" I meant that I don't believe policies will adapt to address the problem when it arises. I believe that humanity will shift all cognitive labor to AI it can
85.
by khafra 1y ago
One outcome which is not unique to AI, but fairly exclusive: The value of human cognitive labor eventually drops below subsistence income. This isn't here, yet; but it's a hard problem so we should be devoting substantial resource
86.
by khafra 1y ago
> Then fund science. Just because the government has done it previously doesn't mean it always has to be like that forever. I do. I'm not one of these wealthy startup founders, just a guy earning a salary--but I've donated
87.
by khafra 1y ago
An interesting exercise would be to let a friend into this restricted shell, with a prize for breaking out and running rm -rf / --no-preserve-root. Then you know to switch to something higher-security once LLM capabilities reach the le
88.
by khafra 1y ago
If you tell DeepSeek you're going to jump off a cliff, DeepSeek will tell you to go for it*; but I don't think it's going to beat Anthropic or OpenAI. * https://www.lesswrong.com/posts/iGF7YcnQkEbwvYLPA&#
89.
by khafra 1y ago
My two claims: 1. OpenAI has been doing verifier-guided training since last year. 2. No SOTA model was trained without verified reward training for math and programming. I supported the first claim with a document describing what OpenAI was
90.
by khafra 1y ago
https://openai.com/index/prover-verifier-games-improve-legib... OpenAI has been doing verifier-guided training since last year. No SOTA model was trained without verified reward training for math and programming.

More ›