Direction-selective ganglion cells (DSGCs) are tuned to motion in one direction. Starburst amacrine cells (SACs) are thought to mediate this direction selectivity through precise anatomical wiring to DSGCs. Nevertheless, we previously found that visual adaptation can reverse DSGCs's directional tuning, overcoming the circuit anatomy. Here we explore the role of SACs in the generation and adaptation of direction selectivity. First, using pharmacogenetics and two-photon calcium imaging, we validate that SACs are necessary for direction selectivity. Next, we demonstrate that exposure to an adaptive stimulus dramatically alters SACs' synaptic inputs. Specifically, after visual adaptation, On-SACs lose their excitatory input during light onset but gain an excitatory input during light offset. Our data suggest that visual stimulation alters the interactions between rod- and cone-mediated inputs that converge on the terminals of On-cone BCs. These results demonstrate how the sensory environment can modify computations performed by anatomically defined neuronal circuits.