I am applying ml to a healthcare domain, and one of the challenges is irrational faith in the outcome. My model says things like - based on your past diet, you

I am applying ml to a healthcare domain, and one of the challenges is irrational faith in the outcome. My model says things like - based on your past diet, you must drink more coffee and eat fewer chicken wings and.... When I showed this to a nutritionist, she is alarmed and think people who use my app might switch to an all-coffee diet! Now the ml model is simply interpreting features to minimize the loss function. It doesn't know what is coffee, or what will happen to a human if he switches to an all-coffee diet in reality. One of the VCs said my app was like a GPS for the body. This is awesome and problematic in the same way - if your GPS tells you to turn right and it's pitch dark and you just do what the GPS says and fall off a cliff, is it the GPS's fault ? Perhaps you didn't pay the annual update fee so it's working off of the old maps. However in the big picture I agree with you. Now is the time to be building these things.