If something like 1 in 5 men have been sexually assaulted in their lifetime, we're a pretty large minority. That makes us relatively normal, doesn't it? After all, "normal" people who have absolutely nothing that makes them some kind of minity - people who have not been abused, are heterosexual, are able-bodied, are the dominant ethnicity and religion for their country - are pretty rare. Most people are labeled "abnormal" in some way.
The problem is that us, the "abnormal" majority, don't always get along with each other. I know that before I knew about my own childhood I didn't "get" male survivors. I know that before I found out about my own sexual orientation I bullied boys who acted "gay". I might still be bigoted against some minority and not even be aware of it.
But I don't think it's healthy to think of ourselves as abnormal. We are normal. We are normal because we, like nearly everyone else in the world, have not lived ideal lives.