You can call it bullshit and in a way it is, but dismissing it in this way means you miss out on what it's good for. Creativity often involves generating ideas

You can call it bullshit and in a way it is, but dismissing it in this way means you miss out on what it's good for. Creativity often involves generating ideas in playful ways, using techniques that aren't really justified and can generate ideas that often don't work. Many of the ideas are wrong. But if you test one of them and it works, it becomes meaningful. Similarly, chatbots can be used to generate ideas but you need to do the testing. It works best if testing is inherently part of the process. You can ask a chatbot to recommend a paper to read, and look for it using Google. If it doesn't exist, you find out right away. Or you ask it to generate some code. You read it over and it makes sense, and you try it and it works. (It probably shouldn't be your only source of ideas and there's a question of how much testing you need to do.)