Bankrate's Greg McBride says their research is showing they say it's just not affordable. "The inability to save for a down payment and closing costs is very definitely an obstacle. It's a bi-product of household budgets being absolutely shredded by the inflation we have been seeing