The fluorescent sterol delta 5,7,9,(11)-cholestatrien-3 beta-ol (cholestatrienol) was incoporated into 1-palmitoyl-2-oleoyl-phosphatidylcholine (POPC) small unilamellar vesicles (SUV) with and without cholesterol in order to monitor sterol-sterol interactions in model membranes. Previously another fluorescent sterol, dehydroergosterol (F. Schroeder, Y. Barenholz, E. Gratton and T.E. Thompson. Biochemistry 26 (1987) 2441), was used for this purpose. However, there is some concern that dehydroergosterol may not be the best analogue for cholesterol. Fluorescence properties of cholestatrienol in POPC SUV were highly sensitive to cholestatrienol purity. The fluorescence decay of cholestatrienol in the POPC SUV was analyzed by assuming either that the decay is comprised of a discrete sum of exponential components or that the decay is made up of one or more component's distribution of lifetimes. The decay for cholestatrienol in POPC SUV analyzed using distributions had a lower chi 2 value and was described by a two-component Lorentzian function with centers near 0.86 and 3.24 ns, and fractional intensities of 0.96 and 0.04, respectively. Both distributions were quite narrow, i.e., 0.05 ns full-width at half-maximum peak height. It is proposed that the two lifetime distributions are generated by separate continua of environments for the cholestatrienol molecule described by different dielectric constants. In the range 0-6 mol% cholestatrienol, the cholestatrienol underwent a concentration-dependent relaxation. This process was characterized by red-shifted absorption and maxima and altered ratios of absorption and fluorescence excitation maxima. Fluorescence quantum yield, lifetime, steady-state anisotropy, limiting anisotropy and rotational rate remained constant. In contrast, in POPC vesicles containing between 6 and 33 mol% cholestatrienol, the fluorescent cholestatrienol partially segregated, resulting in quenching. Thus, below 6 mol% cholestatrienol, the cholestatrienol appeared to behave in part as monomers exposed to some degree to the aqueous solvent in a sterol-poor domain within POPC bilayers. Since the lifetime did not decrease above 6 mol% cholestatrienol, the fluorescence at high mol% values of cholestatrienol was due to cholestatrienol in the sterol-poor domain. The fluorescence intensity, quantum yield, steady-state anisotropy, and limiting anisotropy of cholestatrienol in the sterol-poor domain decreased to limiting, nonzero values while the rotational rate increased to a limiting value. Thus, the sterol-poor domain became more disordered when it coexisted with the sterol-rich domain.(ABSTRACT TRUNCATED AT 400 WORDS)