A Fox Point man facing federal charges is being accused of defrauding investors of more than $5.5 million through two separate investment schemes, including allegedly using the money for “Ponzi-like payments to prior investors and to fund his own lifestyle.”