It doesn't really matter who he left your mother for. After my father dumped my mother for another woman, I wouldn't even speak to him for at least a couple of decades.
And I regret that a lot. You can never get that time back.
And I regret that a lot. You can never get that time back.