We used palaeoproteomics and peptide mass fingerprinting to obtain secure species identifications of key specimens of early domesticated fauna from South Africa, dating to ca. 2000 BP. It can be difficult to distinguish fragmentary remains of early domesticates (sheep) from similar-sized local wild bovids (grey duiker, grey rhebok, springbok—southern Africa lacks wild sheep) based on morphology alone. Our analysis revealed a Zooarchaeology by Mass Spectrometry (ZooMS) marker (m/z 1532) present in wild bovids and we demonstrate through LC–MS/MS that it is capable of discriminating between wild bovids and caprine domesticates. We confirm that the Spoegrivier specimen dated to 2105 ± 65 BP is indeed a sheep. This is the earliest directly dated evidence of domesticated animals in southern Africa. As well as the traditional method of analysing bone fragments, we show the utility of minimally destructive sampling methods such as PVC eraser and polishing films for successful ZooMS identification. We also show that collagen extracted more than 25 years ago for the purpose of radiocarbon dating can yield successful ZooMS identification. Our study demonstrates the importance of developing appropriate regional frameworks of comparison for future research using ZooMS as a method of biomolecular species identification.