Tax audits are essential for governments to raise revenue but they can create economic distortions. To avoid the financial burden of an audit, firms may remain small, move to the informal sector, or shut down. Leveraging detailed administrative tax data from the Ugandan Revenue Authority (URA), a novel linked survey, and a regression discontinuity design (RDD), we show that audits have a dual negative effect in our context: They reduce the tax revenue collected from audited firms \textitand impose large economic distortions. Audited firms are 11 percentage points (p.p.) likelier to shut down, and those that remain operational reduce their output. The former result is driven by firms that must pay substantial back taxes and the latter by firms that believe they are likely to be audited again soon. Back-of-the-envelope calculations indicate that comprehensive audits lead to an overall revenue loss and, to the first order, an aggregate output loss. Our results demonstrate that comprehensive audits impose large costs on audited firms and ultimately hurt both revenue collection efforts and the real economy.