A man pins a woman down on a bed, clamps his hand over her mouth, and tries to remove her clothes -- what on God's green earth do you think he was intending, the administration of lotions for possible dermatitis? The annual asymmetric mole inspection? If the allegations are credible, I don't think we need to establish "whipping it out" to disqualify him as a justice on Scotus.
That said, without some corroboration from someone else at the party, we're in he-said, she-said territory and people will mostly believe in accordance with their ideology.