Coalescence times for three genes provide sufficient information to distinguish population structure from population size changes
- 20 July 2018
- journal article
- research article
- Published by Springer Nature in Journal of Mathematical Biology
- Vol. 78 (1-2) , 189-224
Abstract
The increasing amount of genomic data currently available is expanding the horizons of population genetics inference. A wide range of methods have been published allowing to detect and date major changes in population size during the history of species. At the same time, there has been an increasing recognition that population structure can generate genetic data similar to those generated under models of population size change. Recently, Mazet et al. (Heredity 116(4):362–371, 2016 ) introduced the idea that, for any model of population structure, it is always possible to find a panmictic model with a particular function of population size-change having an identical distribution of \(T_{2}\) (the time of the first coalescence for a sample of size two). This implies that there is an identifiability problem between a panmictic and a structured model when we base our analysis only on \(T_2\). In this paper, based on an analytical study of the rate matrix of the ancestral lineage process, we obtain new theoretical results about the joint distribution of the coalescence times \((T_3,T_2)\) for a sample of three haploid genes in a n-island model with constant size. Even if, for any \(k \ge 2\), it is always possible to find a size-change scenario for a panmictic population such that the marginal distribution of \(T_k\) is exactly the same as in a n-island model with constant population size, we show that the joint distribution of the coalescence times \((T_3,T_2)\) for a sample of three genes contains enough information to distinguish between a panmictic population and a n-island model of constant size.
Keywords
All Related Versions
Funding Information
- Agence Nationale de la Recherche (ANR-16-EBI3-0014)
- Fundaco para a Ciencia e a Tecnologia (Biodiversa/0003/2015)
- PT-DLR (01LC1617A)
- Labex (ANR-10-LABX-41)
This publication has 35 references indexed in Scilit:
- The Confounding Effect of Population Structure on Bayesian Skyline Plot Inferences of Demographic HistoryPLOS ONE, 2013
- Genetic data suggest a natural prehuman origin of open habitats in northern Madagascar and question the deforestation narrative in this regionProceedings of the National Academy of Sciences, 2012
- The Confounding Effects of Population Structure, Genetic Diversity and the Sampling Scheme on the Detection and Quantification of Population Size ChangesGenetics, 2010
- Distinguishing between population bottleneck and population subdivision by a Bayesian model choice procedureMolecular Ecology, 2010
- Genetic Signature of Anthropogenic Population Collapse in Orang-utansPLOS Biology, 2006
- Recent developments in genetic data analysis: what can they tell us about human demographic history?Heredity, 2004
- TESTING FOR GENETIC EVIDENCE OF POPULATION EXPANSION AND CONTRACTION: AN EMPIRICAL ANALYSIS OF MICROSATELLITE DNA VARIATION USING A HIERARCHICAL BAYESIAN MODELEvolution, 2002
- The age of a mutation in a general coalescent treeCommunications in Statistics. Stochastic Models, 1998
- Sampling theory for neutral alleles in a varying environmentPhilosophical Transactions of the Royal Society B: Biological Sciences, 1994
- Inbreeding coefficients and coalescence timesGenetics Research, 1991