Or.. if you really wanted to spend a couple of million dollars you could challenge the bank's liquidated damages clause in your contractual arrangement stating that its a penalty and doesn't reflect the bank's estimated loss....
(or at least you could with Australian law.. i believe the banks themselves are paying a plaintiff to take it up to the high court so there can be some certainty over whether those clauses reflect a reasonable amount of loss to the banks)