My Grocery Store "idea"

I was wondering last night, as I realized we needed groceries, which store we should go to. When I'm in the mood, I'll go to the nicer store even though it's more expensive. I'm not fooling myself into thinking the products are better. Kind of like Whole Foods. I like to shop there every once and a while, but I really dont care if my bananas are organic or anything. I just like shopping around less shitty people just as much as the larger selection of non-standard items. So, I'm willing to spend the extra money. I think that's why most people do it. To stay away from the Walmart type shoppers, they'll spend more.

So my question is, do you think people could be honest with themselves about it. If I started a nicer upscale grocery store and our advertisement always ended with "Shop at X-groceries. Where we may cost a little more, but you don't have to be around poor people!" You think people would run with it, or would the PC backlash be too big. Not trying to be an arse, just wondering if people are honest enough with themselves to realize thats why at least half the people shop at Whole Foods in the first place.