No he wasn't zoning out, piecing things together. Things he'd rather ignore are completely different from zoning out. She clearly doesn't know him at all. He continues to stalk away even after she calls after him. Then he hears her trying to catch up. He turns and faces her. All annoyance and deductions without consideration to others coming out.

"Only a handful of people call you by your name. You paused. Added your husband. You are acting overly familiar with me. Which is a pity really, because it tells me what I need to know. You know an 'older version of me.' Who also calls you by your name. Conclusion: your husband is a supposed older version of me. Yes, supposed. Anyone who has known me more than five minutes would tell you I'm married to my work. And you... you are far from my work."

He needs Mrs Hudson here to say 'Norbury'. Oh well. He continues on. "I am not who you think I am and I will not play party to some strange substitute you are trying to create. I can deal with more trouble than you can imagine. And if you really do know this 'older version of me,' you would know that. Conclusion: you don't know me at all."

With that, he turns away. And practically runs. This is not someone he wants to encounter again. She makes it too obvious just how broken his Mind Palace is, and he won't be able to fix it with that level of distraction around.

He needs to find the dungeon. At this point, he'll even take Moriarty, over everyone else he's encountered so far.