The peopling of Greenland has a complex history shaped by population migrations, isolation and genetic drift. The Greenlanders present a genetic heritage with components of European and Inuit groups; previous studies using uniparentally inherited markers in Greenlanders have reported evidence of a sex-biased, admixed genetic background. This work further explores the genetics of the Greenlanders by analysing autosomal and X-chromosomal data to obtain deeper insights into the factors that shaped the genetic diversity in Greenlanders. Fourteen Greenlandic subsamples from multiple geographical settlements were compared to assess the level of genetic substructure in the Greenlandic population. The results showed low levels of genetic diversity in all sets of the genetic markers studied, together with an increased number of X-chromosomal loci in linkage disequilibrium in relation to the Danish population. In the broader context of worldwide populations, Greenlanders are remarkably different from most populations, but they are genetically closer to some Inuit groups from Alaska. Admixture analyses identified an Inuit component in the Greenlandic population of approximately 80%. The sub-populations of Ammassalik and Nanortalik are the least diverse, presenting the lowest levels of European admixture. Isolation-by-distance analyses showed that only 16% of the genetic substructure of Greenlanders is most likely to be explained by geographic barriers. We suggest that genetic drift and a differentiated settlement history around the island explain most of the genetic substructure of the population in Greenland.