The Perfect Memory Question

Severian is confused when a carnofix was brought in the previous night. He doesn't know how he got to the lazer it, right? And this for somebody who quote unquote has a perfect memory should be a moment of concern for that person, right? But we'll learn later that he did kind of wander around and kind of a confused state for a little bit. That would worry me personally as someone with that perfect memory.