I am sorry to hear of all your troubles. You need to take care of yourself. You are doing the best you can--seek support from others who understand, do not let those that do not or do not want to understand be part of your life now. You have enough on your plate, and negative influences, words or actions will only make your situation worse.
Take some time for yourself, do something you enjoy or makes you happy. You are there for him, many of us did not have someone like you at our side, and would have given the world for the support you are giving--many talk the talk but few walk the talk. Be proud of yourself you are walking it.
Now you may not realize it, but as your husband heals he will remember those that stood by him and learn to distance himself from those who were cruel and abandoned him until they accept what he has lived.
I was not hospitalized for a breakdown but rather for dissociative fugues. Hospitalizations can be scary but he is in good hands with experts who understand what he has lived. Hopefully, the doctors understand trauma and CSA, this is important for your husband to feel safe.
Take care of yourself, let the anger out--you need to let it out and not fester inside you. Vent here anytime you need to, we are pretty much a nonjudgmental group of people who have lived through the pain, anger and hurt of CSA.