In general I think that Soxtalk is a pretty racist free zone, there might be a couple of exceptions here and there, but in general I think people get caught up in the hyperfocus of a single play or two and use those plays to cloud their memories over the ones that aren't especially meaningful.
If we are being fully honest here, there are plenty of white players of White Sox history who have been roasted on Soxtalk for doing baseball stupid things, Chris Sale being the first one that comes to mind. There are definitely others, and it really doesn't correspond to race or heritage very well.