This interaction can and does occur between humans. So, what you do is, ask multiple different people. Get the second opinion. This is only dangerous becau

This interaction can and does occur between humans. So, what you do is, ask multiple different people. Get the second opinion. This is only dangerous because our current means of acquiring, using and trusting information are woefully inadequate. So this debate boils down to: "Can we ever implicitly trust a machine that humans built?" I think the answer there is obvious, and any hand wringing over it is part of an effort to anthropomorphize weak language models into something much larger than they actually are or ever will be.