Unfortunately, people's human nature is to see differences and pass judgements on those differences.
So, if you got a scholarship from your church to go to college and they turned out to be anti-homosexuals. Would you, in turn, be considered homophobic by-proxy because you accepted said scholarship?