You don’t have to claim you are a licensed medical professional to be sued for medical advice that harms someone. You just need to present your advice in a way

You don’t have to claim you are a licensed medical professional to be sued for medical advice that harms someone. You just need to present your advice in a way that a reasonable person would assume that you have some kind of medical expertise. Based on the confident manner with which all LLMs present their answers and based on the fact that people are clearly using LLMs for their medical expertise, I think it would be pretty easy to go after one for giving medical advice that caused actual damages.