Clarence is sick of Ginny and rather than having the courage to talk to her, even through intermediaries, he instead is using his seat on the the court to get interracial marriage rolled back.
In his mind outlawing abortion is just a step on his personal path to freedom while he still has his youth to enjoy it.