Is my boss being very, very slightly pervy?

I think he made a sexual joke but i think it isn't proper to do that at work with someone who work with you.