Anorexia nervosa (AN) is a severe psychiatric disorder with a complex and poorly understood etiology. Recent studies have sought to investigate differences in white matter microstructure in AN, with significant results in several brain regions. A systematic literature search of Embase, PubMed and Psychinfo databases was conducted in order to identify Diffusion Tensor Imaging (DTI) studies of patients with AN and controls. We performed a meta-analysis of studies that met our inclusion criteria (N = 13) using effect size-signed differential mapping (AES-SDM) to detect differences in Fractional Anisotropy (FA) in patients with AN (N = 227) compared to healthy controls (N = 243). The quantitative meta-analysis of DTI studies identified decreased FA in the posterior areas of the corpus callosum, the left superior longitudinal fasciculus II, and the left precentral gyrus, as well as increased FA in the right cortico-spinal projections, and lingual gyrus in AN vs. controls. Studies of WM architecture are still limited in AN; further studies with longitudinal design are needed to better understand the complexity of abnormalities, and their persistence.