Difference Between Simpson’s Probability-Based Diversity Index and Lieberson’s Interaction-Based Diversity Index

Masayoshi Oka

doi:10.22146/jp.117447

Difference Between Simpson’s Probability-Based Diversity Index and Lieberson’s Interaction-Based Diversity Index

https://doi.org/10.22146/jp.117447

Masayoshi Oka^(1*)

(1) Department of Management Faculty of Management Josai University
(*) Corresponding Author

Abstract

Simpson’s probability-based diversity index has been widely used in many fields of study (e.g., ecology, economics, and social sciences). However, it has long been criticized for the lack of clear understanding of what is being measured. To address such a concern, the purpose of this study was to explain how Simpson’s probability-based diversity index can be formulated into an interaction-based diversity index (i.e., Lieberson’s interaction-based diversity index) and to highlight the importance of interpretability and decomposability in the measurement of diversity. Population estimates by race and ethnicity in the District of Columbia were used to demonstrate these points. Therefore, population diversity by sociodemographic groups may be conceived as the extent of interaction among two or more mutually exclusive groups. While further considerations are needed for Lieberson’s interaction-based diversity index to be effective in capturing the distributional pattern of population diversity in geographic space (e.g., handling different population sizes and incorporating spatial information), it may provide a new avenue for moving beyond the probabilistic meaning of diversity and for quantifying population diversity by majority or minority groups and/or by different combinations of majority or minority groups (e.g., two-group diversity, three-group diversity, and four-group diversity).

Keywords

Simpson’s Diversity Index; Probability-based Diversity Index; Lieberson’s Diversity Index; Interaction-based Diversity Index

Full Text:

PDF

References

Alesina, A., Devleeschauwer, A., Easterly, W., Kurlat, S., Wacziarg, R. (2003). Fractionalization. Journal of Economic Growth, 8(2), 155–194. https://doi.org/10.1023/A:1024471506938

Biemann, T., Kearney, E. (2010). Size does matter: How varying group sizes in a sample affect the most common measures of group diversity. Organizational Research Methods, 13(3), 582–599. https://doi.org/10.1177/1094428109338875

Blau, P. M. (1977). Inequality and heterogeneity: A primitive theory of social structure. New York, NY: Free Press. Cromartie, J. (2018). Rural america at a glance, 2018 edition. United States Department of Agriculture, Economic Research Service.

Davis, J. C., Rupasingha, A., Cromartie, J., Sanders, A. (2022). Rural america at a glance: 2022 edition. United States Department of Agriculture, Economic Research Service.

del Río, C., Alonso-Villar, O. (2022). On measuring segregation in a multigroup context: Standardized versus unstandardized indices. Social Indicators Research, 163(2), 633–659. https://doi.org/10.1007/s11205-022-02911-y

Farrell, C. R., Lee, B. A. (2011). Racial diversity and change in metropolitan neighborhoods. Social Science Research, 40(4), 1108–1123. https://doi.org/10.1016/j.ssresearch.2011.04.003

Feitosa, F. F., Câmara, G., Monteiro, A. M. V., Koschitzki, T., Silva, M. P. S. (2007). Global and local spatial indices of urban segregation. International Journal of Geographical Information Science, 21(3), 299–323. https://doi.org/10.1080/13658810600911903

Fotheringham, A. S. (1997). Trends in quantitative methods i: Stressing the local. Progress in Human Geography, 21(1), 88–96. https://doi.org/10.1191/030913297676693207

Greenberg, J. H. (1956). The measurement of linguistic diversity. Language, 32(1), 109–115. https://doi.org/10.2307/410659

Hall, M., Tach, L., Lee, B. A. (2016). Trajectories of ethnoracial diversity in American communities, 1980–2010. Population and Development Review, 42(2), 271–297. https://doi.org/10.1111/j.1728-4457.2016.00125.x

Haziza, D., Beaumont, J.-F. (2017). Construction of weights in surveys: A review. Statistical Science, 32(2), 206–226. https://doi.org/10.1214/16-STS608

Hill, M. O. (1973). Diversity and evenness: A unifying notation and its consequences. Ecology, 54(2), 427–432. https://doi.org/10.2307/1934352

Hurlbert, S. H. (1971). The nonconcept of species diversity: A critique and alternative parameters. Ecology, 52(4), 577–586. https://doi.org/10.2307/1934145

Jost, L. (2006). Entropy and diversity. Oikos, 113(2), 363–375. https://doi.org/10.1111/j.2006.0030-1299.14714.x

Kye, S. H., Halpern-Manners, A. (2023). If residential segregation persists, what explains widespread increases in residential diversity? Demography, 60(2), 583–605. https://doi.org/10.1215/00703370-10597829

Lieberson, S. (1969). Measuring population diversity. American Sociological Review, 34(6), 850–862. https://doi.org/10.2307/2095977

Logan, J. R., Zhang, C. (2010). Global neighborhoods: New pathways to diversity and separation. American Journal of Sociology, 115(4), 1069–1109. https://doi.org/10.1086/649498

McDonald, D. G., Dimmick, J. (2003). The conceptualization and measurement of diversity. Communication Research, 30(1), 60–79. https://doi.org/10.1177/0093650202239026

Meyer, P., McIntosh, S. (1992). The USA today index of ethnic diversity. International Journal of Public Opinion Research, 4(1), 51–58. https://doi.org/10.1093/ijpor/4.1.51

Mora, R., Ruiz-Castillo, J. (2011). Entropy-based segregation indices. Sociological Methodology, 41(1), 159–194. https://doi.org/10.1111/j.1467-9531.2011.01237.x

Morris, E. K., Caruso, T., Buscot, F., Fischer, M., Hancock, C., Maier, T. S., et al. (2014). Choosing and using diversity indices: Insights for ecological applications from the german biodiversity exploratories. Ecology and Evolution, 4(18), 3514–3524. https://doi.org/10.1002/ece3.1155

Morrison, M. L., Rosenberg, N. A. (2023). Mathematical bounds on shannon entropy given the abundance of the ith most abundant taxon. Journal of Mathematical Biology, 87(5), 76. https://doi.org/10.1007/s00285-023-01997-3

Office of the Deputy Mayor for Education. (2025). Total population trends. https://edscape.dc.gov/page/pop-and-students-total-population-trends Oka, M. (2023). Neighborhood-level residential isolation and neighborhood comp

osition: Similar but different. Journal of Urban Health, 100(5), 987–1006. https://doi.org/10.1007/s11524-023-00750-x

Parisi, D., Lichter, D. T., Taquino, M. C. (2011). Multi-scale residential segregation: Black exceptionalism and america's changing color line. Social Forces, 89(3), 829–852. https://doi.org/10.1353/sof.2011.0013

Parisi, D., Lichter, D. T., Taquino, M. C. (2015). The buffering hypothesis: Growing diversity and declining black-white segregation in america’s cities, suburbs, and small towns? Sociological Science, 2(8), 2330–6696. https://doi.org/10.15195/v2.a8

Peet, R. K. (1974). The measurement of species diversity. Annual Review of Ecology and Systematics, 5, 285–307. https://doi.org/10.1146/annurev.es.05.110174.001441

Pfeffermann, D. (1993). The role of sampling weights when modeling survey data. International Statistical Review / Revue Internationale de Statistique, 61(2), 317–337. https://doi.org/10.2307/1403631

R Core Team. (2025). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Rao, C. R. (1982). Diversity and dissimilarity coefficients: A unified approach. Theoretical Population Biology, 21(1), 24–43. https://doi.org/10.1016/0040-5809(82)90004-1 Reardon, S. F., Firebaugh, G. (2002). Measures of multigroup segregation. Sociological Methodology, 32(1), 33–67. https://doi.org/10.1111/1467-9531.00110

Reardon, S. F., O'Sullivan, D. (2004). Measures of spatial segregation. Sociological Methodology, 34(1), 121–162. https://doi.org/10.1111/j.0081-1750.2004.00150.x

Ricotta, C., Szeidl, L., Pavoine, S. (2021). Towards a unifying framework for diversity and dissimilarity coefficients. Ecological Indicators, 129, 107971. https://doi.org/10.1016/j.ecolind.2021.107971

Shannon, C. E. (1948a). A mathematical theory of communication. Bell System Technical Journal, 27(3), 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x

Shannon, C. E. (1948b). A mathematical theory of communication. Bell System Technical Journal, 27(4), 623–656. https://doi.org/10.1002/j.1538-7305.1948.tb00917.x

Shannon, C. E., Weaver, W. (1949). The mathematical theory of communication. Urbana, IL: The University of Illinois Press. Simpson, E. H. (1949). Measurement of diversity. Nature, 163(4148), 688. https://doi.org/10.1038/163688a0

Solon, G., Haider, S. J., Wooldridge, J. M. (2015). What are we weighting for? The Journal of Human Resources, 50(2), 301–316. https://doi.org/10.3368/jhr.50.2.301

Strong, W. L. (2016). Biased richness and evenness relationships within shannon–wiener index values. Ecological Indicators, 67, 703–713. https://doi.org/10.1016/j.ecolind.2016.03.043

Theil, H. (1972). Statistical decomposition analysis: With applications in the social and administrative sciences. New York, NY: American Elsevier Publishing Company.

United States Census Bureau. (2021). Measuring racial and ethnic diversity for the 2020 census. https://www.census.gov/newsroom/blogs/random-samplings/2021/08/measuring-racial-ethnic-diversity-2020-census.html

United States Census Bureau. (2022). Glossary. https://www.census.gov/programs-surveys/geography/about/glossary.html

United States Census Bureau. (2023a). About racial and ethnic diversity. https://www.census.gov/topics/population/racial-ethnic-diversity/about.html

United States Census Bureau. (2023b). Diversity index equation. https://www2.census.gov/programs-surveys/demo/about/racial-ethnic-diversity/diversity-index-equation.pdf

United States Census Bureau. (2023c). Statistical quality standards. https://www.census.gov/about/policies/quality/standards.html

United States Census Bureau. (2024a). About the hispanic population and its origin. https://www.census.gov/topics/population/hispanic-origin/about.html United States Census Bureau. (2024b). About the topic of race. https://www.census.gov/topics/population/race/about.html

United States Census Bureau. (2025a). District of columbia - census bureau profile. https://data.census.gov/profile/District_of_Columbia?g=040XX00US11

United States Census Bureau. (2025b). Explore census data. https://data.census.gov White, M. J. (1983). The measurement of spatial segregation. American Journal of Sociology, 88(5), 1008–1018.

White, M. J. (1986). Segregation and diversity measures in population distribution. Population Index, 52(2), 198–221. https://doi.org/10.2307/3644339

Wong, D. W. S. (1998). Measuring multiethnic spatial segregation. Urban Geography, 19(1), 77–87. https://doi.org/10.2747/0272-3638.19.1.77

Wong, D. W. S. (2002). Modeling local segregation: A spatial interaction approach. Geographical & Environmental Modelling, 6(1), 81–97. https://doi.org/10.1080/13615930220127305

Wong, D. W. S. (2003). Spatial decomposition of segregation indices: A framework toward measuring segregation at multiple levels. Geographical Analysis, 35 (3), 179–194. https://doi.org/10.1111/j.1538-4632.2003.tb01109.x

Wong, D. W. S. (2016). Chapter 5: From aspatial to spatial, from global to local and individual: Are we on the right track to spatialize segregation measures? In F. M. Howell, J. R. Porter, & S. A. Matthews (Eds.), Recapturing space: New middle-range theory in spatial demography (pp. 77–98). Cham, Switzerland: Springer International Publishing. https://doi.org/10.1007/978-3-319-22810-5_5

Yao, J., Wong, D. W. S., Bailey, N., Minton, J. (2019). Spatial segregation measures: A methodological review. Tijdschrift Voor Economische en Sociale Geografie, 110(3), 235–250. https://doi.org/10.1111/tesg.12305

Zhang, W., Logan, J. R. (2016). Global neighborhoods: Beyond the multiethnic metropolis. Demography, 53(6), 1933–1953. https://doi.org/10.1007/s13524-016-0516-4

Zhang, W., Logan, J. R. (2025). Neighborhood transitions and local racial/ethnic diversity, 1980 to 2020. Socius: Sociological Research for a Dynamic World, 11, 23780231251377842. https://doi.org/10.1177/23780231251377842

DOI: https://doi.org/10.22146/jp.117447