Tax audits are essential for governments to raise revenue but they can create economic distortions. To avoid the financial burden of an audit, firms may remain small, move to the informal sector, or shut down. Leveraging detailed administrative tax data from the Ugandan Revenue Authority (URA), a novel linked survey, and a regression discontinuity design (RDD), we show that audits have a dual negative effect in our context: They reduce the tax revenue collected from audited firms \textitand impose large economic distortions. Audited firms are 11 percentage points (p.p.) likelier to shut down, and those that remain operational reduce their output. The former result is driven by firms that must pay substantial back taxes and the latter by firms that believe they are likely to be audited again soon. Back-of-the-envelope calculations indicate that the overall revenue collected from audited firms declines. The total wage bill loss induced by the audits is equivalent to 0.2-0.6% of the total wage bill of the formal economy at baseline, suggesting that the auditing process potentially imposes a large distortion to the Ugandan economy.