It makes perfect sense. We always tend to self-doubt because it is sometimes incomprehensible that someone could be that sick and twisted to do that to us.
One thing that you could ask Andy to do when these things crop up is to actually talk to you. Remind you where you are and who you are with. Remind you that he is someone who would never hurt you and that he is NOT your brother. Remind you that this is only a "body memory" and that something bad like this will never happen again... even if it did, you are an adult now and you have the right to push the hands away and say NO!
I think I remember you saying that there have been times when Andy was in with you at the T's office. Maybe discuss these incidents with the T with Andy there. Your T may have some other suggestions for him to use. You're very lucky to have someone like him to stays with you and is willing to help you through this. AND, if you make him an active part of the process, it will help him to understand even more fully what goes on in your head. Because, if you are even a little bit like me, I tend to keep everything locked up inside and my wife has to play a guessing game of "How does he feel today? What's going through his mind?" That's one thing that I know I have to work on - trusting and letting her know what's going on inside my head.
Hope this helps.
There are no unresolved issues - they just didn't resolve themselves the way we would have liked. "Grinder and Bandler - Neuro-Linguistic Programming"