Correct me if I'm wrong but

I've noticed that the empress is mentioned when Fain is around but he only seems to notice the 4th time. Am I right? If yes, is this an inconsistency or something, he didn't notice?