Abstract: The spatial features of ultrafast changes in magnetic textures carry detailed information on microscopic couplings and energy transport mechanisms. Electrons excel in imaging such picosecond or shorter processes at nanometer length scales. We review the range of physical interactions that produce ultrafast magnetic contrast with electrons, and specifically highlight the recent emergence of ultrafast Lorentz transmission electron microscopy. From the fundamental processes involved in demagnetization at extremely short timescales to skyrmion-based devices, we show that ultrafast electron imaging will be a vital tool in solving pressing problems in magnetism and magnetic materials where nanoscale inhomogeneity, microscopic field measurement, non-equilibrium behavior or dynamics are involved. Graphic abstract: [Figure not available: see fulltext.]