Black holes can be produced in collapse of small-scale dark matter structures, which can happen at any time from the early to present-day Universe. Microstructure black holes (MSBHs) can have a wide range of masses. Small MSBHs evaporate via Hawking radiation with lifetimes shorter than the age of the Universe, but they are not subject to the usual early-Universe bounds on the abundance of small primordial black holes. We investigate the possible signal of such a population of exploding, late-forming black holes, constraining their abundance with observations from diffuse extragalactic gamma- and x-ray sources, the Galactic Center, and dwarf spheroidal galaxies.