Why do you doubt this? Even me, the most skeptical of all blue people on here, thinks he didn't know about this. If he allows her to live in a slum, he must not have a very close relationship with her.
Then why was she mentioned in his memoir? They're a lot closer than you think.