On Thursday, former Dallas fed president Richard Fisher slammed House Speaker Nancy Pelosi and her husband Paul over allegations of insider trading.

"Clearly people have taken advantage of inside information forever," Fisher told CNBC, responding to a Thursday report from Punchbowl News that House Democrats are set to propose a ban on lawmakers, their spouses, and senior staff from trading stocks.

"I'm sorry to see that Paul Pelosi and Nancy Pelosi and others appear to have taken advantage of inside information."