3 ms·
That's why those systems are still safe.
by mirekrusin 4y ago
That's why those systems are still safe.
- ilaksh 4y agoThere are lots of examples of people adding layers on top to provide a more complex and useful cognitive architecture. But still the core is GPT-4 which has some guardrails and also most importantly has limitations on its speed and IQ. See AutoGPT or David Shapiro's cognitive architecture stuff. Really you could just say "use the notes.txt file to record high-level notes about your tasks" and include that with each prompt, and it could then write to its own memory and affect its own cognition. When the performance of the core model increases to say X times human speed/IQ, that is going to determine whether it is dangerous. Even it if has little metacognition or is only directed by a person, if you have something with say 180 IQ and 100 (or whatever numbers you choose) times human speed of thought, then humans will be moving in extreme slow motion relative to it. That is what makes it hard or impossible to control (or possibly the human directing it). Once you have that high level of performance in public, it will be absolutely impossible to enforce everyone to add whatever safety rules you want or prevent them from adding metacognition.
- mirekrusin 4y agoIt helps with safety because context it can operate on is limited. It doesn't matter if you use conversation history or automatically prepend text of notes.txt in it - it still works the same way having the same limits.