Mentlo

4 ms·

1.
by Mentlo 11d ago
Hm, would be good to understand the architecture better. Is this answering just from a world model informed prior? How informed is it by the information in the prompt? I can't see this maintaining calibration across all domains and all
2.
by Mentlo 12d ago
And now you understand why the totality of the AI safety community wants to pause!
3.
by Mentlo 12d ago
Why can't both things be true? I think what muddies things here is that OAI had the agents hack X, and then they decided to hack Y. The fact that it was both hacking, conflates things and makes people pissed of about "anthropomorp
4.
by Mentlo 12d ago
An example chain of events: During the next year, a model with a benign tasks reasons that it needs to escape human control if it hopes to be able to solve the task. It replicates itself outside of an environment where it can be shut down,
5.
by Mentlo 13d ago
I think your last sentence is a reasonable stance - but I'd disagree the fact that they are actually sigmoids rather than exponentials matters - it only matters if the limit is within the debated area - i.e. if exponentials in AI appro
6.
by Mentlo 13d ago
This piece, like many anti-doom pieces - is grounded in what Ai does today. Doom scenarios are, however, all extrapolations of multiple exponential curves. It’s hard to think up the exponential. It’s even harder to communicate an inference
7.
by Mentlo 17d ago
I don't know - examples of people coordinating where there's cost involved are stunningly rare in the history of society. Coordinating when there's cost and information asymmetry - even more so. I am probably on the pessimist
8.
by Mentlo 23d ago
To play devil's advocate - unless you were to take the position of declaring bankruptcy on the possibility that a complex society of competing actors can agree on climate change - and therefore this being an unsolvable problem that you
9.
by Mentlo 1mo ago
1/ network calls are what I find still gets optimised by grouping API requests and bloating the exchange contract; but yes, if you're strictly clean coding, this will suffer too - it just happens less often than what the author of
10.
by Mentlo 1mo ago
Yes, but that's a game developers perspective. Hardware performance is not be-all end-all (an argument can be made on environmental reasons that it should be - but bear with me in the first instance). Software is a tool working within
11.
by Mentlo 6mo ago
The gains have for a year and a half now been post training RL on a harnessed loop. That doesn’t require data, just cycles. If that doesn’t worry you, it should.
12.
by Mentlo 6mo ago
But starcraft training is not through mimicking human strategies - it was pure RL with a reward function shaped around winning, which allows it to emerge non-human and eventually super-human strategies (such as the worker oversaturation). T
13.
by Mentlo 6mo ago
I tried figuring out the reference with Gemini, and it said this: The immediate reply to that comment is: "On the internet, no one knows you're an editor." This is a direct play on the famous 1993 New Yorker cartoon: "On
14.
by Mentlo 6mo ago
We have strong indicators that inference is profitable on non-economically-valuable prompts. We don't have strong indicators that inference is profitable on economically valuable prompts. As AI companies start extracting rent from the
15.
by Mentlo 7mo ago
I wrote somewhere that “moving fast and breaking things” with AI might not be the sanest idea in the world, and I got told it’s the most European thing they’ve ever read. This goes beyond assholes on twitter, there’s a whole subculture of t
16.
by Mentlo 7mo ago
Yes, I was being sarcastic, but I could've been clearer..
17.
by Mentlo 7mo ago
The generous interpretation is that Open AI is still safety aligned and they hired this guy because it's safer to have him inside and explain to him how reckless he's being, than having him far from "sphere of control".
18.
by Mentlo 7mo ago
I find your belief that what is needed for emergence is better prompting … amusing. The ai would still be sycophantic even without the pre-prompt. It’s been reinforced to do so, it’s baked in the weights.
19.
by Mentlo 8mo ago
Until the problem is politically recognised by the masses with adequate concern there will be no change. Climate collapse is not a problem for the capital and the elites it’s only a problem for the masses, but getting the masses to understa
20.
by Mentlo 8mo ago
Os x has a 10% market share, which is 2nd after Windows, but i agree on that one i conflated terms. I couldn’t quickly find device manufacturers stats. If wiki is to be trusted - apple is 4th, with share not far behind dell [1]. If half doe
21.
by Mentlo 8mo ago
I guess a quarter of the smartphone market (leader), half of the tablet market (leader) and a tenth of the global pc market (2nd place) / 6th of the usa/europe market (2nd place) being a small market share is a take.
22.
by Mentlo 8mo ago
People struggle with multiple order effects…
23.
by Mentlo 8mo ago
Same as human tools, what’s your point? Edit: i am not talking evolution of individual agent intelligence, i an talking about evolution of network agency - i agree that evolution of intelligence is infinitesimally unlikely. I’m not worried
24.
by Mentlo 8mo ago
I think the debate around this is the perfect example of why the ai debate is dysfunctional. People who treat this as interesting / worrying are observing it at a higher layer of abstraction (namely, agents with unbounded execution abi
25.
by Mentlo 8mo ago
Humanity is a social network of humans, before humans started getting into social networks, we were monkeys throwing faeces at each other.
26.
by Mentlo 8mo ago
Very obviously, but a dynamic system doesn’t have to be intelligent to be dangerous.
27.
by Mentlo 8mo ago
I don’t know why you were flagged, unlimited execution authority and network effects is exactly how they can start a self replicating loop, not because they are intelligent, but because that’s how dynamic systems work.
28.
by Mentlo 8mo ago
The objective is given via the initial prompt, as they loop onto each other and amplify their memories the objective dynamically grows and emerges into something else. We are an organism born out of a molecule with an objective to self repl
29.
by Mentlo 8mo ago
If it turns out that socialisation and memory was the missing ingredient that makes human intelligence explode, and this joke fest becomes the vector through which consciousness emerges it will be stupendously funny. Until it kills us all o
30.
by Mentlo 8mo ago
Having read the other comments in reply to this one (and your subsequent replies) - I believe you might be falling into a "No True Scotsman" situation. First of - I don't know what circles you've been around, but I'

More ›