I'm not sure I understand, "mind" means "object to", so they are asking "Do you [object to] me sitting here?"; "Not at all" == "I do Not [object to you sitting

I'm not sure I understand, "mind" means "object to", so they are asking "Do you [object to] me sitting here?"; "Not at all" == "I do Not [object to you sitting here] at all"