Intelligence is composed of a set of cognitive abilities hierarchically organized. General and specific abilities capture distinguishable, but related, facets of the intelligence construct. Here, we analyze gray matter with three morphometric indices (volume, cortical surface area, and cortical thickness) at three levels of the intelligence hierarchy (tests, first-order factors, and a higher-order general factor, g). A group of one hundred and four healthy young adults completed a cognitive battery and underwent high-resolution structural MRI. Latent scores were computed for the intelligence factors and tests were also analyzed. The key finding reveals substantial variability in gray matter correlates at the test level, which is substantially reduced for the first-order and the higher-order factors. This supports a reversed hierarchy in the brain with respect to cognitive abilities at different psychometric levels: the greater the generality, the smaller the number of relevant gray matter clusters accounting for individual differences in intelligent performance.