Obesity and extracellular matrix (ECM) density are considered independent risk and prognostic factors for breast cancer. Whether they are functionally linked is uncertain. We investigated the hypothesis that obesity enhances local myofibroblast content in mammary adipose tissue and that these stromal changes increase malignant potential by enhancing interstitial ECM stiffness. Indeed, mammary fat of both diet- and genetically induced mouse models of obesity were enriched for myofibroblasts and stiffness-promoting ECM components. These differences were related to varied adipose stromal cell (ASC) characteristics because ASCs isolated from obese mice contained more myofibroblasts and deposited denser and stiffer ECMs relative to ASCs from lean control mice. Accordingly, decellularized matrices from obese ASCs stimulated mechanosignaling and thereby the malignant potential of breast cancer cells. Finally, the clinical relevance and translational potential of our findings were supported by analysis of patient specimens and the observation that caloric restriction in a mouse model reduces myofibroblast content in mammary fat. Collectively, these findings suggest that obesity-induced interstitial fibrosis promotes breast tumorigenesis by altering mammary ECM mechanics with important potential implications for anticancer therapies.