Of course not. They were sleeping in separate rooms. It was a marriage of convenience at the height of his popularity in Japan with the release of 'The Mad Chinaman', because a rival threatened to out his homosexuality which would sound a death knell for his Tokyo groupie fan base.
Dick Lee once famously said that he considered straight folks abnormal.