I would say close the window of chat app kill the ongoing chat session more surprising than not. The worst you should do is a prompt with yes/no and a checkbox

I would say close the window of chat app kill the ongoing chat session more surprising than not. The worst you should do is a prompt with yes/no and a checkbox to remember my decision when you do it the first time.