The other thing to remember is that, being men, we are not allowed to show any weakness or pain - big boys don't cry. As a result, a lot of things that really aren't anger come out that way.
See, it's okay for us to be angry and critical. It is not okay to be hurt, sad, feel isolated, confused, unworthy, useless, ugly, etc... so, we get mad at ourselves for feeling that way, and those around us only see the anger, not the real emotions.
A simple "Okay, you work it out, I'll be here." can diffuse that.
Chances are he isn't upset that you got rid of whatever it was, to him that probably looked like you thought he was too weak or fragile to handle having it around. No that was not your intent but, that's how it can feel to us when others try to protect. We are supposed to be doing the protecting, not needing or wanting it.
Next time try. "Okay, that bothers you. What would you like me to do with it?"