Remember the erratic behavior demonstrated by "Sydney", the Bing GPT bot? Whether the model has the "cognitive" ability to "prefer" something is not relevant. T

Remember the erratic behavior demonstrated by "Sydney", the Bing GPT bot? Whether the model has the "cognitive" ability to "prefer" something is not relevant. The model has the ability to submit search engine queries now; this is a read only operation for now. Once we give the bot write ability, erratic behavior has the potential to cause real world damage. Whether it is an actual "preference" or something that only looks like one based on the output is purely academic at that point.