Of course, in the real world, if you live in a racist town/city/area, it's not always easy, and can be life-threatening/job-threatening etc, to stand against the vast majority.
No job, no income, no hope, ...so over into the swamp you have to go to live, lucky if the town throws you some scraps.