No, visitation rights are not conditioned on the non-custodial spouse’s keeping with other provisions of the divorce decree.  If they are not paying child support then tell your lawyer or the child support recovery unit but you still have to let him see the kids or you will be in violation of a court order just as much as the other spouse is.