Clinamenic
Binary & Tweed
If we're including men better known as theoretical physicists than as mathematicians per se, then Einstein, Pauli and Feynman were all total horndogs.
And Stephen Hawking's name apparently features on the flight logs of Epstein's jet, so make of that what you will.