Father refuses to force his 5-year-old and 9-year-old kids to accept his mother’s unpleasant, unreliable boyfriend: ‘That wasn’t up for discussion’