She is a woman grown - I should guess her age as some twenty-five years - who has naught but six years of memory.

[Despite the way he leans into the latter half of the sentence, it's still not more than irritation as opposed to genuine anger, and much of it fades away again as he continues on.]

Of which she has spoken little and less, for the most part.

[Indeed, prior to Tony's mention of it he had not had any concrete details on how much memory she had to her name, save for 'less than would be expected'. Nor has it much been a topic that he has cared to delve too deeply into. It is her past, and should she wishes to mention it, he trusts her to do so.]

I will grant that it takes two to argue. But neither will I fault her for choosing to do so.