There is more to fiscal conservatism than simply not running a deficit, although that is one of the primary elements of fiscal conservatism ...
Another major element of being a fiscal conservative is the belief that the government should only be involved in things that they can deliver more efficiently than the private sector; or areas where the private sector has little or no interest in delivering a product.