The IRS views failing to pay payroll taxes as the cardinal sin of tax delinquency because a large portion of the payroll taxes are your employees' withholdings. Not paying your company's payroll taxes is tantamount to stealing your employees' money in the eyes of the IRS.