Esophageal adenocarcinoma arises from Barrett's esophagus, a precancerous metaplastic replacement of squamous by columnar epithelium in response to chronic inflammation. Multi-omics profiling, integrating single-cell transcriptomics, extracellular matrix proteomics, tissue-mechanics and spatial proteomics of 64 samples from 12 patients' paths of progression from squamous epithelium through metaplasia, dysplasia to adenocarcinoma, revealed shared and patient-specific progression characteristics. The classic metaplastic replacement of epithelial cells was paralleled by metaplastic changes in stromal cells, ECM and tissue stiffness. Strikingly, this change in tissue state at metaplasia was already accompanied by appearance of fibroblasts with characteristics of carcinoma-associated fibroblasts and of an NK cell-associated immunosuppressive microenvironment. Thus, Barrett's esophagus progresses as a coordinated multi-component system, supporting treatment paradigms that go beyond targeting cancerous cells to incorporating stromal reprogramming.