yeck

12 ms·

91.
by yeck 3y ago
I find it so troubling that the most common HN response to this isn't to engage with the ideas or logic behind the concerns, but simply to speculate on the unknowable intentions of those that signed the letter. We can base our argument
92.
by yeck 3y ago
Hah, yes. I thought I'd get started with Rust going through building some basic data structures. Linked lists were near the top of my list so I didn't get very far with that first approach XD
93.
by yeck 3y ago
I don't think the purpose of getting the prompt leaked was to then use the prompt but just to expose the limitations of this approach to steering an LLM.
94.
by yeck 3y ago
Not sure if this counts, but there is this "game" that was making the rounds the other day: https://gandalf.lakera.ai/ Created by a company researching techniques for prevent prompt leaks. Play the game and prove
95.
by yeck 3y ago
There are also rules that can easily be interpreted as competing or contradictory in certain cases. For instance, "Follow the user's requirements carefully & to the letter" seems like it could easily conflict with any of
96.
by yeck 3y ago
I wasn't even able to get to repos or users/orgs for a while (though as I write this it seems like that is coming back).
97.
by yeck 3y ago
You could argue that training a model is essentially a lossy compression algorithm resulting a compressed artifact that can be non-deterministically decompressed.
98.
by yeck 3y ago
This presumes a lot of breakthroughs in model interpretability, corrigibility and of inner alignment. Since those are a prerequisite for AGI that we can live along side, I'd have some amount of relief that we found at least a temporary
99.
by yeck 3y ago
I have had many similar experiences with just the free version of ChatGPT. Now I also ask questions more immediately. In the past, when a bunch of new terms or concepts were thrown at me, the effort to stop and dig into each of them via Goo
100.
by yeck 3y ago
The character simulacrum used by an LLM tends to be the result of "system" prompts that set by the service you are using. GPT-N isn't exactly trained to be helpful and nice, but ChatGPT has system prompts describing the chara
101.
by yeck 3y ago
Alignment is an unsolved problem. None of the current stronger models are "aligned", just tuned in ways that weight some biases more than others, but even that is dependant of the features of their inputs.
102.
by yeck 3y ago
"It is refreshing to hear opinions I already agree with. People with other opinions are unintelligent" Is that what you were trying to convey? If not, I'm curious to know what you find refreshing about it and why those who di
103.
by yeck 3y ago
Both these options don't feel good to me. Hard to really tell what is ultimately worse, when I can imagine similar outcomes when irresponsible or malicious agents have access to sufficiently powerful AI. Main positive point for open mo
104.
by yeck 3y ago
What your essentially saying is "alignment is very hard", which is what those researching alignment say. And they often use the example of how inter-human alignment is hard as evidence for why it is a hard problem. But saying it i
105.
by yeck 3y ago
Doesn't understanding language require that a model understands trends in the features of text embeddings inputted into it? And haven't we found that the more text and transformers the complex the trends it can understand in that
106.
by yeck 3y ago
Thanks. While I don't personally need to be convinced of the existential risks for AGI/ASI, I was also genuinely interested in know what might serve as a good, clear "canonical" argument for why the risk is present. Defi
107.
by yeck 3y ago
Accidents are a big risk, but don't underestimate the number of individuals and small groups that have fundamentally anti-social philosophies. I think of groups like antinatalists, doomsday religious groups, traditional terrorist orgs.
108.
by yeck 3y ago
Max gives an example of what he considers a present AI failure: social media recommendation algorithms. He argues that these algos optimize engagement behaviours by exposing users to content that makes them angry, confirms previous biases.
109.
by yeck 3y ago
> has partially trained GPT-5 From my understanding they are training their new GPT models off of a checkpoint from the previous generation, so they technically have partially trained multiple future models in their GPT lineage.
110.
by yeck 3y ago
Yeah, disappointing to see this downvoted, and without even any down voters attempting to make a case for why this isn't a "good" answer. I think that this part of the field is going to see a lot of relative growth as the bro
111.
by yeck 3y ago
If you are going in this direction, please consider working on AI safety and alignment problems. Things like interpretability and corrigibility are keys to creating systems we can understand and "steer". Both are necessary if we h
112.
by yeck 3y ago
I am not sure it even matters either way. It is certainly possible to do things like this right now, and "kidnapped" or "arrested" family member scams are well established as existing. The significance of this report is
113.
by yeck 3y ago
Yeah, I found that to be in poor taste and very unnecessary.
114.
by yeck 3y ago
I did a quick search and found this among a list of many: https://voice.ai/
115.
by yeck 3y ago
Because it is digital. Other technology adoption was slow to spread, because it couldn't simply be cloned and integrate immediately with most pre-existing infrastructure. AI can be copied and can integrate with a lot of existing infras
116.
by yeck 3y ago
In a world where people need to be constantly paranoid, I think many will develop true paranoia, or just give up trying to understand what is going on and defer to who has the power already. Certainly it is not possible for individuals to s
117.
by yeck 3y ago
Training new SOTA (state-of-the-art) models does require a large amount of compute resources. So we could at least pause here and not make more powerful models publicly available until we understand the implications of wtf actually just hap
118.
by yeck 4y ago
Well, that's not very convincing.
119.
by yeck 4y ago
In reality, it is likely only a small handful of companies that would pause, given that very few actually are actually positioned atm to train models larger than GPT-4. Recommend this read for more context on the discussion: https:/&#
120.
by yeck 4y ago
If you are interested, you may find this worth reading: https://thezvi.substack.com/i/111749937/additional-responses... Not a complete answer, but gives a good deal of context around the discussion, I think.

More ›