The thing about casual racism is that they are not in the open enough for you to call them out as racist. Often, they are so borderline, you almost feel that if you say something, people, including people who are not White - or even your own friends - will accuse you of overreacting.