Legally this isn't enough to create sexual harassment liability. A one off comment typically doesn't create a hostile work environment. But many one-off comment

Legally this isn't enough to create sexual harassment liability. A one off comment typically doesn't create a hostile work environment. But many one-off comments over a period of time does. So while it isn't sexual harassment yet, if the OP doesn't take steps to make sure it doesn't happen again, he could be facing liability for future actions. unless there is a quid pro quo element.