You can have as many friends and family and have no issues if your friends and families aren't getting into shite that drags you down
This is why I think there is a larger problem of "community." I can speak to one example...
I grew up in a probably 90-10 white area which was pretty affluent. We always had black kids around (just not a ton), and race relations were good to great. The black kids were generally from affluent families like everyone else, and although they played thug from time to time, they were pretty upstanding people who've gone on to good things. We were very integrated in most things, and there were always very well liked black students in the crowds I ran in.
After I graduated, my town began to change quickly to a very popular area for middle and upper middle class black families. Not much changed at first, but more and more people from neighboring areas (that were majority-minority and which were not as nice) began coming in to shop, eat, etc. Crime began to rise, white flight occurred, and property values plummeted (obviously the recession spurred this too).
It really sucked to see my community go to crap, but I also felt for the black families who moved in seeking a nice, safe area, and didn't leave when it got bad. My conclusion from that little scenario is that there were some communal ties that prevented those families from taking much of a stand when the community went downhill, because to do so may involve opposing your friends, family members, church members, etc. I just don't feel like the black community is to the point yet where there is no stigma for "hating on your own."