robbensinger

4 ms·

1.
by robbensinger 9y ago
The thing I'm pointing to is that there are certain (relatively) specialized tasks like 'par-human biotech innovation' that require more or less the same kind of thinking that you'd need for arbitrary tasks in the physic
2.
by robbensinger 9y ago
Eliezer's Q was, "What is the least impressive milestone you feel very, very confident will not be achieved in the next 2 years?" It's true that "least" will make it harder to come up with an example quickly. (
3.
by robbensinger 9y ago
I think there are two questions here: (1) "Is general intelligence even a thing you can invent? Like, is there a single set of faculties underlying humans' ability to build software, design buildings that don't fall down, not
4.
by robbensinger 10y ago
I agree that "that's Pascal's wager!" isn't a reasonable response to someone arguing that, say, a 1% or 10% extinction risk is worth taking seriously. If you think the probability is infinitesimally small but that w
5.
by robbensinger 10y ago
Speaking very roughly, fuzzy logic applies in cases where the degree of truth of a statement is in question. Logical uncertainty (about decidable sentences) applies in cases where the sentences are definitely true or false, but we lack the
6.
by robbensinger 11y ago
Speaking as a MIRI employee, I can say that MIRI isn't trying to build AI that's mathematically provable to be safe. This misconception comes from the same place the "AI safety engineering, etc." post is speaking to -- t
7.
by robbensinger 11y ago
The problems aren't completely unprecedented (else we'd have basically no knowledge about them), but they become more severe in the scenarios Bostrom/Russell/etc. are talking about. I would say that the central concern i
8.
by robbensinger 11y ago
Stuart Russell (co-author of AI:MA, one of MIRI's research advisors) argues on http://edge.org/conversation/the-myth-of-ai#26015 that AI systems with "the ability to make high-quality decisions" (where &
9.
by robbensinger 11y ago
I replied to this here: https://news.ycombinator.com/item?id=10721068 . Short answer is that collaborations don't look unlikely, and we'll be able to say more when OpenAI's been up and running longer.
10.
by robbensinger 11y ago
MIRI employee here! We're on good terms with the people at OpenAI, and we're very excited to see new AI teams cropping up with an explicit interest in making AI's long-term impact a positive one. Nate Soares is in contact wit