3 ms·
If you make the human write the code on a whiteboard without a python interpreter, they are likely to occasionally make up libraries that don't exist. The LLM
by _ea1k 3y ago
If you make the human write the code on a whiteboard without a python interpreter, they are likely to occasionally make up libraries that don't exist.
The LLM is operating similarly in a lot of cases. It doesn't have an IDE with intellisense acting as an immediate feedback mechanism.
- SirMaster 3y agoBut when you ask the LLM where you can read about the library it's referencing (that it made up), it then makes up a URL for it that has never existed, (at least according to the internet archive). A human certainly doesn't do that in my experience. Apparently LLMs know when they are making stuff up (or so I keep getting told that over and over by others here). But clearly they are terrible at communicating about when they are making things up which is a big problem to me. I wish they would just say when they don't know something rather than make up BS. Plenty of humans are perfectly capable of acknowledging when they don't know something.