It would be weirder if she got married to someone and then hired a guy who tried to rape her to maintain her house and clean her and her husband's car.
I've always wondered that; you'd remember the guy who helped start your romance. If your kid started to look like him....
But then, until he was seventeen, he wasn't involved so they wouldn't have had memories of him being there until he was seventeen because that was when he went back in time... but because he went back in time, he met them when they were younger and *head implodes*.