This isn't about gay or straight, it's about inappropriate behavior and violating boundaries. Most guys who are built like you say you are enjoy a little bit of admiration, but what the other guy is doing crosses many lines.

Tell him you don't like it and want it stopped.