While falling mortgage rates created tailwinds for affordability, there are two major headwinds — layoffs and rising home prices. The U.S. jobless rate jumped to the double digits in the spring. While the labor market has recovered, unemployment remains elevated.