3 ms·
My concern is that this type of policy represents a profound rejection of the Western ideal that ideas and information are not in and of themselves harmful. Le
by RcouF1uZ4gsC 2y ago
My concern is that this type of policy represents a profound rejection of the Western ideal that ideas and information are not in and of themselves harmful.
Let's look at some of the examples of harm that are often used. Take for example nuclear weapons. However, the information for building a nuclear weapon is mostly available. A physics grad student probably has the information needed to build a nuclear weapon. Someone looking up public information has that information as well. The way this is regulated is by carefully tracking and controlling actual physical substances (like uranium, etc).
Similar with biological weapons. Any microbiology grad student would know how to cook up something dangerous. The equipment and supplies would be the much harder thing.
Again, very similar with chemical weapons.
Yet, these "safety" policies act like controlling information is the end and be all.
There is a similar concern with information being misused with flight simulators. For example, it appears that the MH370 disappearance was planned by the pilot using a flight simulator. Yet, we haven't called for "safety" committees for flight simulators.
In addition, the LLMs are only being trained on open data. I am sure there is no classified data that is being used for training. This means, that any information would be available to be found in openly available books and websites.
Remember, this is all text/images in text/images out. This is not like a robot that can actually execute actions.
In addition, there is a sense of Anthropic both overplaying and underplaying how dangerous it is. For example, I did not see references to complete kill switch that when activated would irrevocably destroy Anthropic's code, data, and physical machines to limit the chance of escape.
If you were really serious about believing in the possibility of this level of danger, that would be the first thing implemented, if safety was the first concern.
In addition, this focus on safety and on hiding information and capabilities from the common people, that are only available to a select few is dangerous in and of itself. The desire to anoint oneself as high-priest with privileged access to information/capability is an old human temptation. The earliest city states thousands of years ago had a high priestly class who knew the correct incantations that normal people were kept in the dark about. The Enlightenment turned this type of thinking on its head and we have tremendously benefited.
This type of "safety-first" thinking is taking us back to the intellectual dark ages.