this is certainly true, but the thing about a market is that it reflects aggregate behavior. As long as some people are willing and able to move, that can balance a market without every one having to. So wish you neighbor who decides to move well, because he is helping to lower housing costs in your high cost area by going.
Of course if you own your home already then persuade him to stay put and keep accruing your profits!