Speciation is thought to be predominantly driven by the geographical separation of populations of the ancestral species. Yet, in the marine realm, there is substantial biological diversity despite a lack of pronounced geographical barriers. Here, we investigate this paradox by considering the biogeography of marine mammals: cetaceans (whales and dolphins) and pinnipeds (seals and sea lions). We test for associations between past evolutionary diversification and current geographical distributions, after accounting for the potential effects of current environmental conditions. In general, cetacean lineages are widely dispersed and show few signs of geographically driven speciation, albeit with some notable exceptions. Pinnipeds, by contrast, show a more mixed pattern, with true seals (phocids) tending to be dispersed, whereas eared seals (otariids) are more geographically clustered. Both cetaceans and pinnipeds show strong evidence for environmental clustering of their phylogenetic lineages in relation to factors such as sea temperature, the extent of sea ice, and nitrate concentrations. Overall, current marine mammal biogeography is not indicative of geographical speciation mechanisms, with environmental factors being more important determinants of current taxonomic distributions. However, geographical isolation appears to have played a role in some important taxa, with evidence from the fossil record showing good support for these cases.