Different question. Because - my guess - we believe that we're equal, we can walk down the same streets and go in the same shops and talk to each other. A cat may look at a king as the saying goes, and that is the case for anyone in public spaces, regardless of how wealthy or posh we are. Dividing up public spaces depending on how much money people have feels wrong - and parts of a building outside the door of the flat have always been viewed as public to the people in the building in the past.
I mean, it's a weird thing, I hardly want to go for a stroll round the floors of a tower block but when I couldn't do it suddenly seemed very restrictive.