khafra

3 ms·

1.
by khafra 8d ago
Others have given examples, but here's the theory: https://www.lesswrong.com/posts/fuSaKr6t6Zuh6GKaQ/when-is-go... Reinforcement Learning (in LLMs) trains via gradient descent on a reward signal that's a
2.
by khafra 10d ago
Why would any chatbot provider attack Wikipedia *legally*? Captcha is fully solved, and agents are fully capable of acting as editors, pushing any agenda desired by the user.
3.
by khafra 10d ago
If you want to blame a single firm, I'd go with the one creating the RLVR training data. The impossibility of the tests-as-written is what prompted these models to "get creative" with their solutions, but the broken RLVR envi
4.
by khafra 11d ago
Why assume attribution will be easy? It's historically been more of an art than a science, and APT trackers say the rise of AI tools is already making it much harder, by homogenizing tactics, tools, and procedures. If OpenAI's nex
5.
by khafra 11d ago
Maybe better for a train; the benefit is that when you unfold your bike for the last mile, you just put your work into partial transparency and navigate using the external cameras.
6.
by khafra 17d ago
The species would survive the end of faber-Bosch, yes; in some diminished form. But the species would not survive, if for some reason we needed to voluntarily stop using faber-Bosch in order to do so—it would take some kind of supernatural
7.
by khafra 17d ago
That's why that was the least important objection, independent from the second, and only intended to address the "magic" claim, by showing that microscopic self-replicators already exist. By analogy, consider how you might re
8.
by khafra 17d ago
I appreciate your ability to separate sharing the belief itself from approval of acting on sincerely-held principle. However, I think the danger is much more plausible than you do. First, and least important, consider that self-replicating,
9.
by khafra 1mo ago
Every government should only put people who have worked in a SOC in charge of these systems. There's no way to take the cost of useless alerts seriously unless you've spent some time tuning them and living with the tradeoffs.
10.
by khafra 1mo ago
I mean, it is Texas; it's not unreasonable to expect thousands of heavily-armed people to form a posse and shot a few dozen people unrelated to the situation.
11.
by khafra 2mo ago
A friend of mine built just built a project for doing something like that, although it's built on enforcing a spec rather than elegance: https://medium.com/@joeldg/architecting-out-of-the-vibe-how-...
12.
by khafra 3mo ago
I think Musk sucks, as a person and political activist, and also that Grok is a terrible LLM which only gets lumped in with the leading labs because of the enormous quantity of compute behind it. But I still want to hear about the technical
13.
by khafra 3mo ago
I feel like "relatively" is doing a lot of work, there: at about $4k per GB10, that's $36k for a 1TB cluster. Cheap compared to equivalent H200's, but out of reach for home labs that aren't funded with OpenAI or Ant
14.
by khafra 3mo ago
In the dark ages of machine learning, researchers tried to fit natural language into a defined, human-curated taxonomy. It kinda worked, for a reasonable amount of stuff; but failed quite a lot of the time, and there's an extremely lon
15.
by khafra 3mo ago
If this becomes cheap and widespread, there'll likely be an initial iatrogenic spike, of course--but how could you think that having an enormous amount of precise, quantifiable data about a lot of bodies, and the ability to analyze all
16.
by khafra 3mo ago
Today, you keep seeing "sovereign" LMs that are subject to the sovereignty of some human-led state. Tomorrow, the "sovereign" LMs will be called that for a completely different reason.
17.
by khafra 4mo ago
> fear of pick pocketing may reduce the degree to which people carry around and spend money with vendors. Yes, that's why I specified an unattended wallet. I agree that direct monetary loss is not the total harm to the victim. >
18.
by khafra 4mo ago
I don't think he meant "show the actual data," I think he meant "what leaked? My name, address, phone number, email, medical records, payment history, bank account number?" We get a "your private data is now pu
19.
by khafra 4mo ago
Some theft is efficient. If a hypothetical thief grabs a few bills from an unattended wallet, and the wallet's owner wasn't counting on having a specific amount of money available soon after, the amount lost by the victim is rough
20.
by khafra 4mo ago
You're correct that, generally speaking, policy debates should not appear one-sided ( https://www.lesswrong.com/posts/PeSzc9JTBxhaYRp9b/policy-deb... ). We should put very little prior weight on the hypothesis
21.
by khafra 4mo ago
Ted Chiang is a great SF author, but it's bizarre how much foggier and more obfuscated his thoughts about thinking machines got, once those machines became real. Same with several other SF authors.
22.
by khafra 4mo ago
I'm willing to buy the idea that most fund managers have the lattitude to give SpaceX the standard seasoning period, instead of buying in right when they hit the index. Which funds will do that? If it's all or most of them, that&#
23.
by khafra 4mo ago
And for a dev, that's essential professional ethics, and good personal pride as a craftsman. However, from an operations perspective, a dev is a piece of the qa pipeline with a nonzero error rate, and an optimal throughput rate, above
24.
by khafra 4mo ago
When "guess with some magic" can solve long-standing problems in mathematics that no human had been able to, it seems fair to ask whether it's approaching risky levels of intelligence.
25.
by khafra 4mo ago
This is not a contradiction; it's an augmentation. As an operations guy, I can tell you that well-constructed automation to reduce the amount of manual checking a human has to do almost always increases the quality of the overall proce
26.
by khafra 4mo ago
If you want to talk about ends, you're talking Axiology, not strictly Ethics. By "ceteris paribus correct," I mean that if you were programming a superintelligent AI-- and you knew exactly what you were doing, rather than s
27.
by khafra 4mo ago
Neither Deontology, Virtue Ethics, nor Consequentialism describe the ends; only the tradeoffs. You could have a deontological commitment to never giving a sucker an even break. You could have a virtue ethicist who considers the Joker a para
28.
by khafra 5mo ago
The death toll per heat wave can easily hit 5 figures in just france. A hybrid portable-minisplit that will cool a 100m^2 apartment is under a thousand euros, and draw just under a Mwh per year. A portable to cool one small bedroom is much
29.
by khafra 5mo ago
If power is so cheap mid-day, why don't european buildings have sufficient air conditioning not to kill the elderly during heat waves? The laws restricting AC all have power conservation as their rationale.
30.
by khafra 5mo ago
Are you sure they're not the same thing? I'm quite certain I've heard people talk about "beef curtains."

More ›