My husband refuses to see the he is an attractive man, and really does not like it when I call him handsome, but I will never stop! He takes great care in his dress, grooming, and lifts weights and is very attractive, but I don't think he likes his body at all. He never seems to be pleased with his body. I see some of the same actions in him that you describe, but not all the time. Sometimes I can touch him, and sometimes not. Sometimes kissing is out of the question, even a hug. I am getting very skilled at gauging his moods, thank goodness, so that hopefully I don't do something he finds distancing or distasteful. It is workable for us, but I do still wish it never had to be this way.