just my take on this -
in some relationships - he sees gifts as OK - a sign of love - like with his kids. no danger or ambiguity there at all. no strings attached.
in some relationships - like with the perp(s) - he sees gifts a a means of control or manipulation - recalling feelings of victimization, vulnerability, and possibly guilt and shame.
for you - he may be confused as to which it is. he may think of it as friendship/love in his conscious, rational mind - BUT subconsciously feel the conditioned responses from the earlier abuse.
at least that's my guess.
"That you are here - that life exists, and identity; that the powerful play goes on and you may contribute a verse. . . What will your verse be?" Robin Williams as John Keating in "Dead Poets Society"