It's perfectly possible to balance the budget, create a surplus and start paying down the debt, and have the debt still increase because the interest exceeds the surplus. This is what happened under Clinton, he created a surplus and started using it to pay down the debt but it wasn't big enough to stop the growth. Had Bush stuck to Clinton policies, it would have been.