Food and Pharmacy - you can buy everything everywhere.

I have a question, a general wondering: what is the real difference between a grocery store and a pharmacy here? I mean, all pharmacies sell groceries and all grocery stores sell pharmaceutical. What makes it one or the other?

CVS, Rite Aid, Shoppers, Harris Teeter. What's really what? I have not managed to figure this out yet. Can anyone please explain?