Sex estimation of skeletons is fundamental to many archaeological studies. Currently, three approaches are available to estimate sex-osteology, genomics, or proteomics, but little is known about the relative reliability of these methods in applied settings. We present matching osteological, shotgun-genomic, and proteomic data to estimate the sex of 55 individuals, each with an independent radiocarbon date between 2,440 and 100 cal BP, from two ancestral Ohlone sites in Central California. Sex estimation was possible in 100% of this burial sample using proteomics, in 91% using genomics, and in 51% using osteology. Agreement between the methods was high, however conflicts did occur. Genomic sex estimates were 100% consistent with proteomic and osteological estimates when DNA reads were above 100,000 total sequences. However, more than half the samples had DNA read numbers below this threshold, producing high rates of conflict with osteological and proteomic data where nine out of twenty conditional DNA sex estimates conflicted with proteomics. While the DNA signal decreased by an order of magnitude in the older burial samples, there was no decrease in proteomic signal. We conclude that proteomics provides an important complement to osteological and shotgun-genomic sex estimation.

Amelogenin genes are located on both X and Y sex chromosomes in humans and are a major focus of DNA-based sex estimation methods. Amelogenin proteins, AMELX_HUMAN and AMELY_HUMAN, are expressed in the tooth organ and play a major role in mineralization of enamel, the most taphonomically resistant, archaeologically persistent human tissue. We describe shotgun liquid chromatography mass spectrometry analysis of 40 enamel samples representing 25 individuals, including modern third molars and archaeological teeth from open-air contexts including permanent adult (400 to 7300 BP) and deciduous teeth (100 to 1000 BP). Peptides specific to the X-chromosome isoform of amelogenin were detected in all samples. Peptides specific to the sexually dimorphic Y-chromosome isoform were also detected in 26 samples from 13 individuals, across all time periods, including previously unsexed deciduous teeth from archaeological contexts. While the signal of each gene product can vary by more than an order of magnitude, we show close agreement between osteological and amelogenin-based sex estimation and thus demonstrate that the protein-based signal can be obtained reliably from open-air archaeological contexts dating to at least 7300 years ago. While samples with AMELY_HUMAN peptides are unambiguously male, samples with no AMELY_HUMAN signal may either be low signal male false negative samples or female samples. In order to estimate sex in these samples we developed a probability curve of female sex as a function of the logarithm of AMELX_HUMAN signal (p < 0.0001) using logistic regression. This is also the first demonstration using proteomics to estimate sex in deciduous teeth and pushes back the application of the method to teeth that are at least 7300 years old.