Organic retinomorphic sensors offer the advantage of in-sensor processing to filter out redundant static backgrounds and are well suited for motion detection. To improve this promising structure, here, the key role of interfacial energetics in promoting charge accumulation to raise the inherent photoresponse of the light-sensitive capacitor is studied. Specifically, incorporating appropriate interfacial layers around the photoactive layer is crucial to extend the carrier lifetime, as confirmed by intensity-modulated photovoltage spectroscopy. Compared to its photodiode counterpart, the retinomorphic sensor shows better detectivity and response speed due to the additional insulating layer, which reduces the dark current and the RC time constant. Lastly, three retinomorphic sensors are integrated into a line array to demonstrate the detection of movement speed and direction, showing the potential of retinomorphic designs for efficient motion tracking.