In the future, banking fines should be used to cut taxes for householders.
This is the opinion of George Osborne and the chancellor wants to make sure that levies aimed at lending institutions for bad behavior benefit the common man.
At present, any penalties - such as the recent £59.5 million ($92.5 million) fine given to Barclays for falsely setting the Libor rate - go right back into the sector in the form of lower regulatory fees.
Speaking to parliament, Mr Osborne revealed he will consider altering the Financial Services Bill so this type of activity no longer goes on.
Which? chief executive Peter Vicary-Smith said it is now clear there is "corruption at the heart of our banking system" and thinks the government has to fast-track reforms.
He has called for a tougher regulatory watchdog to be set up that will defend the interests of consumers against powerful companies.
By Gary Copper