Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Archive
    • Supplementary Material
  • Info for
    • Authors
    • Subscribers
    • Institutions
    • Advertisers
  • About Us
    • About Us
    • Editorial Board
  • Connect
    • Feedback
    • Help
    • Request JHR at your library
  • Alerts
  • Free Issue
  • Special Issue
  • Other Publications
    • UWP

User menu

  • Register
  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Human Resources
  • Other Publications
    • UWP
  • Register
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Human Resources

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Archive
    • Supplementary Material
  • Info for
    • Authors
    • Subscribers
    • Institutions
    • Advertisers
  • About Us
    • About Us
    • Editorial Board
  • Connect
    • Feedback
    • Help
    • Request JHR at your library
  • Alerts
  • Free Issue
  • Special Issue
  • Follow uwp on Twitter
  • Follow JHR on Bluesky
Research ArticleArticles

Testing Attrition Bias in Field Experiments

Dalia Ghanem, Sarojini Hirshleifer and Karen Ortiz-Becerra
Published online before print July 03, 2024, 0920-11190R2; DOI: https://doi.org/10.3368/jhr.0920-11190R2
Dalia Ghanem
Dalia Ghanem is an associate professor of agricultural and resource economics at University of California, Davis ().
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: dghanem{at}ucdavis.edu
Sarojini Hirshleifer
Sarojini Hirshleifer is an assistant professor of economics at University of California, Riverside and CEGA ().
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: sarojini.hirshleifer{at}ucr.edu
Karen Ortiz-Becerra
Karen Ortiz-Beccera is an assistant professor of economics at the University of San Diego ().
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: kortizbecerra{at}sandiego.edu
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • References
  • PDF
Loading

References

    1. Abadie, Alberto,
    2. Matthew M. Chingos, and
    3. Martin R. West
    . 2018. “Endogenous Stratification in Randomized Experiments.” Review of Economics and Statistics, 100(4): 567–580.
    OpenUrl
    1. Ahn, Hyungtaik, and
    2. James L. Powell
    . 1993. “Semiparametric Estimation of Censored Selection Models with a Nonparametric Selection Mechanism.” Journal of Econometrics, 58(1): 3–29.
    OpenUrlCrossRefWeb of Science
    1. Altman, Douglas G.
    1985. “Comparability of Randomised Groups.” Journal of the Royal Statistical Society: Series D (The Statistician), 34(1): 125–136.
    OpenUrl
    1. Altonji, Joseph, and
    2. Rosa Matzkin
    . 2005. “Cross-section and Panel Data Estimators for Non-separable Models with Endogenous Regressors.” Econometrica, 73(3): 1053–1102.
    OpenUrlCrossRefWeb of Science
    1. Anderson, Michael L, and
    2. Jeremy Magruder
    . 2022. “Highly Powered Analysis Plans.” National Bureau of Economic Research.
    1. Andrews, Isaiah, and
    2. Emily Oster
    . 2019. “A simple approximation for evaluating external validity bias.” Economics Letters, 178: 58 – 62.
    OpenUrl
    1. Angrist, Joshua D.,
    2. Guido W. Imbens, and
    3. Donald B. Rubin
    . 1996. “Identification of Causal Effects Using Instrumental Variables.” Journal of the American Statistical Association, 91(434): 444–455.
    OpenUrlCrossRefWeb of Science
    1. Athey, S., and
    2. G.W. Imbens
    . 2017. “Chapter 3 - The Econometrics of Randomized Experiments.” In Handbook of Field Experiments. Vol. 1 of Handbook of Economic Field Experiments, , ed. Abhijit Vinayak Banerjee and Esther Duflo, 73 – 140. North-Holland.
    1. Athey, Susan,
    2. Dean Eckles, and
    3. Guido W. Imbens
    . 2018. “Exact p-Values for Network Interference.” Journal of the American Statistical Association, 113(521): 230–240.
    OpenUrl
    1. Azzam, Tarek,
    2. Michael D. Bates, and
    3. David Fairris
    . 2022. “Do learning communities increase first year college retention? Evidence from a randomized control trial.” Economics of Education Review, 89: 102279.
    OpenUrl
    1. Baird, Sarah,
    2. J. Aislinn Bohren,
    3. Craig McIntosh, and
    4. Berk Özler
    . 2018. “Optimal Design of Experiments in the Presence of Interference.” Review of Economics and Statistics, 100(5): 844–860.
    OpenUrl
    1. Barrett, Garry,
    2. Peter Levell, and
    3. Kevin Milligan
    . 2014. “A Comparison of Micro and Macro Expenditure Measures across Countries Using Differing Survey Methods.” In Improving the Measurement of Consumer Expenditures. NBER Chapters, 263–286. National Bureau of Economic Research, Inc.
    1. Behagel, Luc,
    2. Bruno Crépon,
    3. Marc Gurgand, and
    4. Thomas Le Barbanchon
    . 2015. “Please Call Again: Correcting Nonresponse Bias in Treatment Effect Models.” Review of Economics and Statistics, 97: 1070–1080.
    OpenUrl
    1. Benjamini, Yoav, and
    2. Yosef Hochberg
    . 1995. “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.” Journal of the Royal Statistical Society. Series B (Methodological), 57(1): 289–300.
    OpenUrlCrossRefPubMedWeb of Science
    1. Bester, C. Alan, and
    2. Christian Hansen
    . 2009. “Identification of Marginal Effects in a Nonparametric Correlated Random Effects Model.” Journal of Business and Economic Statistics, 27(2): 235–250.
    OpenUrl
    1. Bruhn, Miriam, and
    2. David McKenzie
    . 2009. “In Pursuit of Balance: Randomization in Practice in Development Field Experiments.” American Economic Journal: Applied Economics, 1(4): 200–232.
    OpenUrlCrossRefWeb of Science
    1. Bugni, Federico A.,
    2. Ivan A. Canay, and
    3. Azeem M. Shaikh
    . 2018. “Inference Under Covariate-Adaptive Randomization.” Journal of the American Statistical Association, 113(524): 1784–1796.
    OpenUrl
    1. Canay, Ivan A.,
    2. Joseph P. Romano, and
    3. Azeem M. Shaikh
    . 2017. “Randomization Tests Under an Approximate Symmetry Assumption.” Econometrica, 85(3): 1013–1030.
    OpenUrl
    1. Carneiro, Pedro,
    2. Sokbae Lee, and
    3. Daniel Wilhelm
    . 2019. “Optimal data collection for randomized control trials.” The Econometrics Journal, 23(1): 1–31.
    OpenUrl
    1. Chen, Xuan, and
    2. Carlos A. Flores
    . 2015a. “Bounds on Treatment Effects in the Presence of Sample Selection and Noncompliance: The Wage Effects of Job Corps.” Journal of Business & Economic Statistics, 33(4): 523–540.
    OpenUrl
    1. Chen, Xuan, and
    2. Carlos A. Flores
    . 2015b. “Bounds on Treatment Effects in the Presence of Sample Selection and Noncompliance: The Wage Effects of Job Corps.” Journal of Business & Economic Statistics, 33(4): 523–540.
    OpenUrl
    1. Chernozhukov, Victor,
    2. Ivan Fernandez-Val,
    3. Jinyong Hahn, and
    4. Whitney Newey
    . 2013. “Average and Quantile Effects in Nonseparable Panel Data Models.” Econometrica, 81(2): pp.535–580.
    OpenUrlCrossRefWeb of Science
    1. Das, Mitali,
    2. Whitney K. Newey, and
    3. Francis Vella
    . 2003. “Nonparametric Estimation of Sample Selection Models.” Review of Economic Studies, 70(1): 33–58.
    OpenUrlCrossRef
    1. de Chaisemartin, Clément, and
    2. Luc Behaghel
    . 2020. “Estimating the Effect of Treatments Allocated by Randomized Waiting Lists.” Econometrica, 88(4): 1453–1477.
    OpenUrl
    1. Dufour, Jean-Marie.
    2006. “Monte Carlo Tests with Nuisance Parameters: A General approach to Finite-Sample Inference and Nonstandard Asymptotics.” Journal of Econometrics, 133(2): 443–477.
    OpenUrlCrossRefWeb of Science
    1. Dufour, Jean-Marie,
    2. Abdeljelil Farhat,
    3. Lucien Gardiol, and
    4. Lynda Khalaf
    . 1998. “Simulation-based Finite Sample Normality Tests in Linear Regressions.” Econometrics Journal, 1(1): 154–173.
    OpenUrl
    1. Fricke, Hans,
    2. Markus Fröhlich,
    3. Martin Huber, and
    4. Michael Lechner
    . 2020. “Endogeneity and non-response bias in treatment evaluation – nonparametric identification of causal effects by instruments.” Journal of Applied Econometrics, 35(5): 481–504.
    OpenUrl
    1. Ghanem, Dalia.
    2017. “Testing Identifying Assumptions in Nonseparable Panel Data Models.” Journal of Econometrics, 197: 202–217.
    OpenUrl
    1. Ghanem, Dalia,
    2. Sarojini Hirshleifer,
    3. Désiré Kédagni, and
    4. Karen Ortiz-Beccera
    . 2023. “Correcting Attrition Bias using Changes-in-Changes.” Unpublished Manuscript.
    1. Glennerster, Rachel, and
    2. Kudzai Takavarasha
    . 2013. Running Randomized Evaluations: A Practical Guide. . Student Edition ed., Princeton University Press.
    1. Hausman, Jerry A., and
    2. David A. Wise
    . 1979. “Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment.” Econometrica, 47(2): 455–473.
    OpenUrlCrossRefWeb of Science
    1. Heckman, James J.
    1976. “The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models.” In Annals of Economic and Social Measurement. Vol. 5,, ed. Sanford V. Berg, 475–492. National Bureau of Economic Research.
    OpenUrlWeb of Science
    1. Heckman, James J.
    1979. “Sample Selection Bias as A Specification Error.” Econometrica, 47(1): 153–161.
    OpenUrlCrossRefWeb of Science
    1. Hirano, Keisuke,
    2. Guido W. Imbens, and
    3. Geert Ridder
    . 2003. “Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score.” Econometrica, 71(4): 1161–1189.
    OpenUrlCrossRefWeb of Science
    1. Hirano, Keisuke,
    2. Guido W. Imbens,
    3. Geert Ridder, and
    4. Donald B. Rubin
    . 2001. “Combining Panel Data Sets with Attrition and Refreshment Samples.” Econometrica, 69(6): 1645–1659.
    OpenUrlCrossRefWeb of Science
    1. Hoderlein, Stefan, and
    2. Halbert White
    . 2012. “Nonparametric Identification of Nonseparable Panel Data Models with Generalized Fixed Effects.” Journal of Econometrics, 168(2): 300–314.
    OpenUrlCrossRefWeb of Science
    1. Horowitz, Joel L., and
    2. Charles F. Manski
    . 2000. “Nonparametric Analysis of Randomized Experiments with Missing Covariate and Outcome Data.” Journal of the American Statistical Association, 95(449): 77–84.
    OpenUrlCrossRefWeb of Science
    1. Horvitz, D. G., and
    2. D. J. Thompson
    . 1952. “A Generalization of Sampling Without Replacement from a Finite Universe.” Journal of the American Statistical Association, 47(260): 663–685.
    OpenUrlCrossRefWeb of Science
    1. Hsu, Yu-Chin,
    2. Chu-An Liu, and
    3. Xiaoxia Shi
    . 2019. “Testing Generalized Regression Monotonicity.” Econometric Theory, 1 – 55.
    1. Huber, Martin.
    2012. “Identification of Average Treatment Effects in Social Experiments Under Alternative Forms of Attrition.” Journal of Educational and Behavioral Statistics, 37(3): 443–474.
    OpenUrlCrossRef
    1. Huber, Martin.
    2014. “Treatment Evaluation in the Presence of Sample Selection.” Econometric Reviews, 33(8): 869–905.
    OpenUrl
  1. IES. 2017. “What Works Clearinghouse. Standards Handbook Version 4.0.” U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, What Works Clearinghouse.
    1. Imbens, Guido W., and
    2. Donald B. Rubin
    . 2015. Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press.
    1. Imbens, Guido W., and
    2. Joshua D. Angrist
    . 1994. “Identification and Estimation of Local Average Treatment Effects.” Econometrica, 62(2): 467–475.
    OpenUrlCrossRefWeb of Science
  2. INSP. 2005. “General Rural Methodology Note.” Instituto Nacional de Salud Publica.
    1. Kasy, Maximilian, and
    2. Anja Sautmann
    . 2021. “Adaptive Treatment Assignment in Experiments for Policy Choice.” Econometrica, 89(1): 113–132.
    OpenUrl
    1. Kitagawa, Toru.
    2015. “A Test for Instrument Validity.” Econometrica, 83(5): 2043–2063.
    OpenUrl
    1. Kline, Patrick, and
    2. Andres Santos
    . 2013. “Sensitivity to Missing Data Assumptions: Theory and An Evaluation of The U.S. Wage Structure.” Quantitative Economics, 4(2): 231–267.
    OpenUrl
    1. Lee, David S.
    2009. “Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects.” Review of Economic Studies, 76(3): 1071–1102.
    OpenUrlCrossRefWeb of Science
    1. Lehmann, E. L., and
    2. Joseph P. Romano
    . 2005. Testing Statistical Hypotheses. . Third ed., New York:Springer.
    1. Manski, Charles F.
    2005. “Partial Identification with Missing Data: Concepts and Findings.” International Journal of Approximate Reasoning, 39(2): 151 – 165.
    OpenUrl
    1. McKenzie, David.
    2012. “Beyond Baseline and Follow-Up: The Case for More T in Experiments.” Journal of Development Economics, 99(2): 210–221.
    OpenUrlCrossRef
    1. Meyer, Bruce D.,
    2. Wallace K. C. Mok, and
    3. James X. Sullivan
    . 2015. “Household Surveys in Crisis.” Journal of Economic Perspectives, 29(4): 199–226.
    OpenUrlCrossRef
    1. Millán, Teresa Molina, and
    2. Karen Macours
    . 2021. “Attrition in Randomized Control Trials: Using Tracking Information to Correct Bias.” Unpublished Manuscript.
    1. Mourifié, Ismael, and
    2. Yuanyuan Wan
    . 2017. “Testing Local Average Treatment Effect Assumptions.” Review of Economics and Statistics, 99(2): 305–313.
    OpenUrl
    1. Muralidharan, K.
    2017. “Chapter 3 - Field Experiments in Education in Developing Countries.” In Handbook of Economic Field Experiments. Vol. 2 of Handbook of Economic Field Experiments,, ed. Abhijit Vinayak Banerjee and Esther Duflo, 323–385. North-Holland.
    1. Muralidharan, Karthik,
    2. Mauricio Romero, and
    3. Kaspar Wüthrich
    . 2023. “Factorial Designs, Model Selection, and (Incorrect) Inference in Randomized Experiments.” The Review of Economics and Statistics, 1–44.
    1. Robins, James M.,
    2. Andrea Rotnitzky, and
    3. Lue Ping Zhao
    . 1994. “Estimation of Regression Coefficients When Some Regressors Are Not Always Observed.” Journal of the American Statistical Association, 89(427): 846–866.
    OpenUrlCrossRefWeb of Science
    1. Rosenzweig, Mark R, and
    2. Christopher Udry
    . 2019. “External Validity in a Stochastic World: Evidence from Low-Income Countries.” The Review of Economic Studies, 87(1): 343–381.
    OpenUrl
    1. Rubin, Donald B.
    1976. “Inference and Missing Data.” Biometrika, 63(3): 581–592.
    OpenUrlCrossRefWeb of Science
    1. Skoufias, Emmanuel.
    2005. “PROGRESA and Its Impacts on The Welfare of Rural households in Mexico.” International Food Policy Research Institute (IFPRI) Research Report 139.
    1. Vazquez-Bare, Gonzalo.
    2022. “Identification and estimation of spillover effects in randomized experiments.” Journal of Econometrics, 105237.
    1. Viviano, Davide.
    2023. “Policy Design in Experiments with Unknown Interference.” Unpublished Manuscript.
    1. Wooldridge, Jeffrey M.
    1995. “Selection corrections for panel data models under conditional mean independence assumptions.” Journal of Econometrics, 68(1): 115 – 132.
    OpenUrlCrossRefWeb of Science
    1. Young, Alwyn.
    2018. “Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results*.” Quarterly Journal of Economics, 134(2): 557–598.
    OpenUrl
PreviousNext
Back to top

In this issue

Journal of Human Resources: 60 (5)
Journal of Human Resources
Vol. 60, Issue 5
1 Sep 2025
  • Table of Contents
  • Table of Contents (PDF)
  • Index by author
  • Front Matter (PDF)
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Human Resources.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Testing Attrition Bias in Field Experiments
(Your Name) has sent you a message from Journal of Human Resources
(Your Name) thought you would like to see the Journal of Human Resources web site.
Citation Tools
Testing Attrition Bias in Field Experiments
Dalia Ghanem, Sarojini Hirshleifer, Karen Ortiz-Becerra
Journal of Human Resources Jul 2024, 0920-11190R2; DOI: 10.3368/jhr.0920-11190R2

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Testing Attrition Bias in Field Experiments
Dalia Ghanem, Sarojini Hirshleifer, Karen Ortiz-Becerra
Journal of Human Resources Jul 2024, 0920-11190R2; DOI: 10.3368/jhr.0920-11190R2
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • References
  • PDF

Related Articles

  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • The Effects of Exposure to a Large-Scale Recession on Higher Education and Early Labor Market Outcomes
  • Intergenerational Mobility Trends and the Changing Role of Female Labor
  • The Health Effects of In Utero Exposure To Cash Transfers
Show more Articles

Similar Articles

Keywords

  • C12
  • C21
  • C23
  • C93
  • non-response
  • treatment effects
  • randomized experiment
  • randomized control trial
  • internal validity
  • identifying assumptions
  • randomization test
  • panel data
UW Press logo

© 2025 Board of Regents of the University of Wisconsin System

Powered by HighWire