The clinical management of coronary artery disease and the prevention of acute coronary syndromes require knowledge of the underlying atherosclerotic plaque pathobiology. Hybrid imaging modalities capable of comprehensive assessment of biochemical and morphological plaques features can address this need. Here we report the first implementation of an intravascular catheter system combining fluorescence lifetime imaging (FLIm) with polarization-sensitive optical coherence tomography (PSOCT). This system provides multi-scale assessment of plaque structure and composition via high spatial resolution morphology from OCT, polarimetry-derived tissue microstructure, and biochemical composition from FLIm, without requiring any molecular contrast agent. This result was achieved with a low profile (2.7 Fr) double-clad fiber (DCF) catheter and high speed (100 fps B-scan rate, 40 mm/s pullback speed) console. Use of a DCF and broadband rotary junction required extensive optimization to mitigate the reduction in OCT performance originating from additional reflections and multipath artifacts. This challenge was addressed by the development of a broad-band (UV-visible-IR), high return loss (47 dB) rotary junction. We demonstrate in phantoms, ex vivo swine coronary specimens and in vivo swine heart (percutaneous coronary access) that the FLIm-PSOCT catheter system can simultaneously acquire co-registered FLIm data over four distinct spectral bands (380/20 nm, 400/20 nm, 452/45 nm, 540/45 nm) and PSOCT backscattered intensity, birefringence, and depolarization. The unique ability to collect complementary information from tissue (e.g., morphology, extracellular matrix composition, inflammation) with a device suitable for percutaneous coronary intervention offers new opportunities for cardiovascular research and clinical diagnosis.