How are you forced into a conversation with a group of people you chose to go somewhere with? If you didn't want to talk with them, don't accept their invitatio

How are you forced into a conversation with a group of people you chose to go somewhere with? If you didn't want to talk with them, don't accept their invitation to get coffee