.... I feel the man was buying my silence. By doing such nice things for my brother, certainly if I ever tried to tell, my brother wouldn't believe me because the man was so nice to him.
You are likely right about this. Its classic pedophile behavior to cover their tracks this way. Good for your brother for have put you first and believed you. And good for you for taking this step. Its scary as hell, but the relief you've gotten is worth it.
"Listen as your day unfolds
Challenge what the future holds
Try and keep your head up to the sky
Lovers, they may cause you tears
Go ahead release your fears
Stand up and be counted
Don't be ashamed to cry " -Des'ree