IRS Penalties and Interest The obligation to pay taxes becomes even more burdensome when accompanied by penalties and interest. The Internal Revenue Service (IRS) imposes tax penalties for various reasons, such as failure to file tax returns on time, inaccurate tax returns, or failure to pay owed taxes. If you find yourself facing an IRS