Financial companies that trade or invest in mortgages are being shunned by debt investors, who are fearful that a rout in the bond market could have left some companies with heavy losses.

"We've been shying away from the financials because of what's going on in the mortgage market," said Gary Pollack, director of fixed-income research and trading at Deutsche Bank Private Wealth Management. "Spreads are just too volatile."