Dog domestication is still largely unresolved due to time-gaps in the sampling of regions. Ancient Italian canids are particularly understudied, currently represented by only a few specimens. In the present study, we sampled 27 canid remains from Northern Italy dated between the Late Pleistocene and Bronze Age to assess their genetic variability, and thus add context to dog domestication dynamics. They were targeted at four DNA fragments of the hypervariable region 1 of mitochondrial DNA. A total of 11 samples had good DNA preservation and were used for phylogenetic analyses. The dog samples were assigned to dog haplogroups A, C and D, and a Late Pleistocene wolf was set into wolf haplogroup 2. We present our data in the landscape of ancient and modern dog genetic variability, with a particular focus on the ancient Italian samples published thus far. Our results suggest there is high genetic variability within ancient Italian canids, where close relationships were evident between both a similar to 24,700 years old Italian canid, and Iberian and Bulgarian ancient dogs. These findings emphasize that disentangling dog domestication dynamics benefits from the analysis of specimens from Southern European regions.