Buildings were just the world's furniture, and he didn't care how it was arranged.

"The Pusher", The Magazine of Fantasy & Science Fiction (October 1981), reprinted in The John Varley Reader (2005)