Yes, I can surely identify with that and I bet other guys can too. In my case the abuser didn't just stop - he was caught and chased away (but never reported of course). But yes, I know what you mean.
I think there are lots of reasons why a boy feels this way. I know for me, after four years abuse was all that seemed real to me; the rest was just pretending, making excuses, hiding the truth, covering up or getting rid of evidence, etc.
A part of it is also that after awhile a boy can feel that abuse is all he's good for - he thinks no one will ever want him or love him after this, or for anything else. So when the abuse stops he can even grieve and feel abandoned. With the abuser gone, now he really is all alone, he thinks.
Does any of this sound familiar? If you have a T this would be a good topic to discuss one day.
Nobody living can ever stop me
As I go walking my freedom highway.
Nobody living can make me turn back:
This land was made for you and me. (Woody Guthrie)