From a corporate standpoint, the big fear is that the LLM might do something that cause a big enough problem to cause the corporation to be sued. For LLMs to be

From a corporate standpoint, the big fear is that the LLM might do something that cause a big enough problem to cause the corporation to be sued. For LLMs to be really useful, they need to be able to do something...like maybe interact with the web. Let's say you ask an LLM to apply to scholarships on your behalf and it does so, but also creates a ponzi scheme to help you pay for college. There isn't really a good way for the company who created the LLM to know that it won't ever try to do something like that. You can limit what it can do, but that also means it isn't useful for most of the things that would really be useful. So eventually a corporation creates an LLM that is used to do something really bad. In the past, if you use your internet connection, email, MS Word, or whatever to do evil, the fault lies with you. No one sues Microsoft because a bomber wrote their todo list in Word. But with the LLM it starts blurring the lines between just being a tool that was used for evil and having a tool that is capable of evil to achieve a goal even if it wasn't explicitly asked to do something evil.