Again: If one State may secede, so may another; and when all shall have seceded none is left to pay the debts. Is this quite just to creditors? Did we notify them of this sage view of ours when we borrowed their money? If we now recognize this doctrine by allowing the seceders to go in peace, it is difficult to see what we can do if others choose to go or to extort terms upon which they will promise to remain.

Fourth of July Address to Congress (1861)