Is tax fraud a federal offense?

Yes. Tax fraud is a violation of the U.S. Code. Most cases of tax evasion and other forms of federal tax fraud are prosecuted as a violation of 26 U.S.C. § 7201. A conspiracy could also be charged under 18 U.S.C. § 371. The IRS is the federal agency that investigates tax crimes.