it's only a tradeoff in areas where residents are not landowners, so the landlords profit off development. which is one of the problems solved by a more equitable distribution of land, like a land-value tax promotes.

in any area where the residents are the landowners, they're being paid a fair price for their land and so the development is not "at the expense" of anybody.