A Practitioner’s Guide to Cluster-Robust Inference

References

1. ↵
   1. Abadie Alberto,
   2. Diamond Alexis,
   3. Hainmueller Jens

   2010. “Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program.” Journal of the American Statistical Association 105(490):493–505.

   OpenUrlCrossRefWeb of Science
2. ↵
   1. Acemoglu Daron,
   2. Pischke Jörn-Steffen

   2003. “Minimum Wages and On-the-Job Training.” Research in Labor Economics 22:159–202.

   OpenUrl
3. ↵
   1. Andrews Donald W.K.,
   2. Stock James H.

   2007. “Inference with Weak Instruments.” In Advances in Economics and Econometrics, Theory and Applications: Ninth World Congress of the Econometric Society, Volume III, ed. Blundell Richard, Newey Whitney K., Persson T., 122–73. Cambridge: Cambridge University Press.

   OpenUrl
4. ↵
   1. Angrist Joshua D.,
   2. Lavy Victor

   2002. “The Effect of High School Matriculation Awards: Evidence from Randomized Trials.” American Economic Review 99:1384–414.

   OpenUrl
5. ↵
   1. Angrist Joshua D.,
   2. Pischke Jörn-Steffen

   2009. Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton: Princeton University Press.
6. ↵
   1. Arellano Manuel

   1987. “Computing Robust Standard Errors for Within-Group Estimators.” Oxford Bulletin of Economics and Statistics 49(4):431–34.

   OpenUrlCrossRefWeb of Science
7. ↵
   1. Barrios Thomas,
   2. Diamond Rebecca,
   3. Imbens Guido W.,
   4. Kolesár Michal

   2012. “Clustering, Spatial Correlations and Randomization Inference.” Journal of the American Statistical Association 107(498):578–91.

   OpenUrlCrossRef
8. ↵
   1. Baum Christopher F.,
   2. Schaffer Mark E.,
   3. Stillman Steven

   2007. “Enhanced Routines for Instrumental Variables/GMM Estimation and Testing.” The Stata Journal 7(4):465–506.

   OpenUrl
9. ↵
   1. Bell Robert M.,
   2. McCaffrey Daniel F.

   2002. “Bias Reduction in Standard Errors for Linear Regression with Multi-Stage Samples.” Survey Methodology 28(2):169–79.

   OpenUrl
10. ↵
    1. Bertrand Marianne,
    2. Duflo Esther,
    3. Mullainathan Sendhil

    2004. “How Much Should We Trust Differences-in-Differences Estimates?” Quarterly Journal of Economics 119(1): 249–75.

    OpenUrlCrossRefWeb of Science
11. ↵
    1. Bester C. Alan,
    2. Conley Timothy G.,
    3. Hansen Christian B.

    2011. “Inference with Dependent Data Using Cluster Covariance Estimators.” Journal of Econometrics 165(2): 137–51.

    OpenUrlCrossRefWeb of Science
12. ↵
    1. Bhattacharya Debopam

    2005. “Asymptotic Inference from Multi-Stage Samples.” Journal of Econometrics 126:145–71.

    OpenUrl
13. ↵
    1. Bound John,
    2. Jaeger David A.,
    3. Baker Regina M.

    1995. “Problems with Instrumental Variables Estimation When the Correlation Between the Instruments and the Endogenous Explanatory Variable is Weak.” Journal of the American Statistical Association 90(430): 443–50.

    OpenUrlCrossRefWeb of Science
14. ↵
    1. Brewer Mike,
    2. Crossley Thomas F.,
    3. Joyce Robert

    2013. “Inference with Differences-in-Differences Revisited.” Unpublished. http://www.iza.org/conference_files/PolicyEval_2013/joyce_r8616.pdf
15. ↵
    1. Cameron A. Colin,
    2. Gelbach Jonah G.,
    3. Miller Douglas L.

    2006. “Robust Inference with Multi-Way Clustering.” NBER Technical Working Paper 0327.
16. ↵
    1. Cameron A. Colin,
    2. Gelbach Jonah G.,
    3. Miller Douglas L.

    2008. “Bootstrap-Based Improvements for Inference with Clustered Errors.” Review of Economics and Statistics. 90(3):414–27.

    OpenUrlCrossRefWeb of Science
17. ↵
    1. Cameron A. Colin,
    2. Gelbach Jonah G.,
    3. Miller Douglas L.

    2011. “Robust Inference with Multi-Way Clustering.” Journal Business and Economic Statistics 29(2):238–49.

    OpenUrl
18. 1. Cameron A. Colin,
    2. Miller Douglas L.

    2011. “Robust Inference with Clustered Data.” In Handbook of Empirical Economics and Finance, ed. Ullah Aman, Giles David E., 1–28. Boca Raton: CRC Press.
19. ↵
    1. Cameron A. Colin,
    2. Miller Douglas L.

    2012. “Robust Inference with Dyadic Data: With Applications to Country-Pair International Trade.” University of California-Davis. Unpublished. http://cameron.econ.ucdavis.edu/research/Cameron_Miller_JHR_2012_July_09.pdf
20. ↵
    1. Cameron A. Colin,
    2. Trivedi Pravin K.

    2005. Microeconometrics: Methods and Applications. Cambridge: Cambridge University Press.
21. ↵
    1. Cameron A. Colin,
    2. Trivedi Pravin K.

    2009. Microeconometrics Using Stata. College Station: Stata Press.
22. ↵
    1. Carter Andrew V.,
    2. Schnepel Kevin T.,
    3. Steigerwald Douglas G.

    2013. “Asymptotic Behavior of a t Test Robust to Cluster Heterogeneity.” University of California-Santa Barbara. Unpublished. http://www.econ.ucsb.edu/~doug/researchpapers/Asymptotic%20Behavior%20of%20a%20t%20Test%20Robust%20to%20Cluster%20Heterogeneity.pdf
23. ↵
    1. Cheng Cheng,
    2. Hoekstra Mark

    2013. “Pitfalls in Weighted Least Squares Estimation: A Practitioner’s Guide.” Texas A&M University. Unpublished.
24. ↵
    1. Chernozhukov Victor,
    2. Hansen Christian

    2008. “The Reduced Form: A Simple Approach to Inference with Weak Instruments.” Economics Letters 100(1):68–71.

    OpenUrlCrossRefWeb of Science
25. ↵
    1. Conley Timothy G

    1999. “GMM Estimation with Cross Sectional Dependence.” Journal of Econometrics 92(1):1–45.

    OpenUrlCrossRefWeb of Science
26. ↵
    1. Conley Timothy G.,
    2. Taber Christopher R.

    2011. “Inference with ‘Difference in Differences’ with a Small Number of Policy Changes.” Review of Economics and Statistics 93(1):113–25.

    OpenUrlCrossRefWeb of Science
27. ↵
    1. Davidson Russell,
    2. Flachaire Emmanuel

    2008. “The Wild Bootstrap, Tamed at Last.” Journal of Econometrics 146(1):162–69.

    OpenUrlCrossRefWeb of Science
28. ↵
    1. Davis Peter

    2002. “Estimating Multi-Way Error Components Models with Unbalanced Data Structures.” Journal of Econometrics 106(1):67–95.

    OpenUrlCrossRefWeb of Science
29. ↵
    1. Donald Stephen G.,
    2. Lang Kevin

    2007. “Inference with Difference-in-Differences and Other Panel Data.” Review of Economics and Statistics 89(2):221–33.

    OpenUrlCrossRefWeb of Science
30. ↵
    1. Driscoll John C.,
    2. Kraay Aart C.

    1998. “Consistent Covariance Matrix Estimation with Spatially Dependent Panel Data.” Review of Economics and Statistics 80(4):549–60.

    OpenUrlCrossRefWeb of Science
31. ↵
    1. Duflo Esther,
    2. Glennerster Rachel,
    3. Kremer Michael

    2007. “Using Randomization in Development Economics Research: A Toolkit.” In Handbook of Development Economics, Volume 4, ed. Rodrik Dani, Rosenzweig Mark, 3895–962. Amsterdam: North-Holland.

    OpenUrlCrossRef
32. ↵
    1. Fafchamps Marcel,
    2. Gubert Flore

    2007. “The Formation of Risk Sharing Networks.” Journal of Development Economics 83(2):326–50.

    OpenUrlCrossRefWeb of Science
33. ↵
    1. Fernández-Val Iván

    2009. “Fixed Effects Estimation of Structural Parameters and Marginal Effects in Panel Probit Models.” Journal of Econometrics 150(1):70–85.

    OpenUrl
34. ↵
    1. Finlay Keith,
    2. Magnusson Leandro M.

    2009. “Implementing Weak Instrument Robust Tests for a General Class of Instrumental-Variables Models.” Stata Journal 9(3):398–421.

    OpenUrl
35. ↵
    1. Fitzsimons Emla,
    2. Malde Bansi,
    3. Mesnard Alice,
    4. Vera-Hernández Marcos

    2012. “Household Responses to Information on Child Nutrition: Experimental Evidence from Malawi.” IFS Working Paper W12/07.
36. ↵
    1. Foote Christopher L

    . 2007. “Space and Time in Macroeconomic Panel Data: Young Workers and State-Level Unemployment Revisited.” Working Paper 07–10, Federal Reserve Bank of Boston.
37. ↵
    1. Greenwald Bruce C

    1983. “A General Analysis of Bias in the Estimated Standard Errors of Least Squares Coefficients.” Journal of Econometrics 22(3):323–38.

    OpenUrl
38. ↵
    1. Hansen Christian

    2007a. “Asymptotic Properties of a Robust Variance Matrix Estimator for Panel Data when T is Large.” Journal of Econometrics 141(2):597–620.

    OpenUrlCrossRefWeb of Science
39. ↵
    1. Hansen Christian

    2007b. “Generalized Least Squares Inference in Panel and Multi-Level Models with Serial Correlation and Fixed Effects.” Journal of Econometrics 141(2):597–620.

    OpenUrlCrossRefWeb of Science
40. ↵
    1. Hausman Jerry,
    2. Kuersteiner Guido

    2008. “Difference in Difference Meets Generalized Least Squares: Higher Order Properties of Hypotheses Tests.” Journal of Econometrics 144(2):371–91.

    OpenUrlCrossRefWeb of Science
41. ↵
    1. Hemming Karla,
    2. Marsh Jen

    2013. “A Menu-Driven Facility for Sample-Size Calculations in Cluster Randomized Controlled Trails.” Stata Journal 13(1):114–35.

    OpenUrl
42. ↵
    1. Hersch Joni

    1998. “Compensating Wage Differentials for Gender-Specific Job Injury Rates.” American Economic Review 88(3):598–607.

    OpenUrl
43. ↵
    1. Hoechle Daniel

    2007. “Robust Standard Errors for Panel Regressions with Cross–sectional Dependence.” Stata Journal 7(3):281–312.

    OpenUrlWeb of Science
44. ↵
    1. Hoxby Caroline,
    2. Daniele Paserman M.

    1998. “Overidentification Tests with Group Data.” NBER Technical Working Paper 0223.
45. ↵
    1. Ibragimov Rustam,
    2. Müller Ulrich K.

    2010. “T-Statistic Based Correlation and Heterogeneity Robust Inference.” Journal of Business and Economic Statistics 28(4):453–68.

    OpenUrlCrossRefWeb of Science
46. ↵
    1. Imbens Guido W.,
    2. Kolesar Michal

    2012. “Robust Standard Errors in Small Samples: Some Practical Advice.” NBER Working Paper 18478.
47. ↵
    1. Inoue Atsushi,
    2. Solon Gary

    2006. “A Portmanteau Test for Serially Correlated Errors in Fixed Effects Models.” Econometric Theory 22(5):835–51.

    OpenUrl
48. ↵
    1. Kézdi Gábor

    2004. “Robust Standard Error Estimation in Fixed-Effects Panel Models.” Hungarian Statistical Review Special Number 9:95–116.

    OpenUrl
49. ↵
    1. King Miriam,
    2. Ruggles Steven,
    3. Trent Alexander J.,
    4. Flood Sarah,
    5. Genadek Katie,
    6. Schroeder Matthew B.,
    7. Trampe Brandon,
    8. Vick Rebecca

    2010. Integrated Public Use Microdata Series, Current Population Survey: Version 3.0. [Machine-readable database]. Minneapolis: University of Minnesota.
50. ↵
    1. Kish Leslie

    . 1965. Survey Sampling. New York: John Wiley.
51. ↵
    1. Kish Leslie,
    2. Frankel Martin R.

    1974. “Inference from Complex Surveys with Discussion.” Journal Royal Statistical Society B 36(1):1–37.

    OpenUrl
52. 1. Kleibergen F.,
    2. Paap R.

    2006. “Generalized Reduced Rank Tests Using the Singular Value Decomposition.” Journal of Econometrics 133(1):97–128.

    OpenUrlCrossRefWeb of Science
53. ↵
    1. Klein Patrick,
    2. Santos Andres

    2012. “A Score Based Approach to Wild Bootstrap Inference.” Journal of Econometric Methods 1(1):23–41.

    OpenUrl
54. ↵
    1. Kloek T

    1981. “OLS Estimation in a Model Where a Microvariable Is Explained by Aggregates and Contemporaneous Disturbances Are Equicorrelated.” Econometrica 49(1):205–207.

    OpenUrlCrossRefWeb of Science
55. ↵
    1. Liang Kung-Yee,
    2. Zeger Scott L.

    1986. “Longitudinal Data Analysis Using Generalized Linear Models.” Biometrika 73(1):13–22.

    OpenUrlCrossRefWeb of Science
56. ↵
    1. MacKinnon James G.,
    2. White Halbert

    1985. “Some Heteroskedasticity-Consistent Covariance Matrix Estimators with Improved Finite Sample Properties.” Journal of Econometrics 29(3):305–25.

    OpenUrlCrossRefWeb of Science
57. 1. MacKinnon James,
    2. Webb Matthew D.

    2013. “Wild Bootstrap Inference for Wildly Different Cluster Sizes.” Queens Economics Department Working Paper Number 1314.
58. ↵
    1. McCaffrey Daniel F.,
    2. Bell Robert M.,
    3. Botts Carsten H.

    2001. “Generalizations of Bias Reduced Linearization.” Proceedings of the Survey Research Methods Section, American Statistical Association.
59. ↵
    1. Miglioretti D.L.,
    2. Heagerty P.J.

    2006. “Marginal Modeling of Nonnested Multilevel Data using Standard Software.” American Journal of Epidemiology 165(4):453–63.

    OpenUrlCrossRefPubMedWeb of Science
60. ↵
    1. Moulton Brent R

    1986. “Random Group Effects and the Precision of Regression Estimates.” Journal of Econometrics 32:385–97.

    OpenUrlCrossRefWeb of Science
61. ↵
    1. Moulton Brent R

    1990. “An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Units.” Review of Economics and Statistics 72(3):334–38.

    OpenUrlCrossRefWeb of Science
62. ↵
    1. Newey Whitney K.,
    2. West Kenneth D.

    1987. “A Simple, Positive Semi-Definite, Heteroscedasticity and Autocorrelation Consistent Covariance Matrix.” Econometrica 55(3):703–708.

    OpenUrlCrossRefWeb of Science
63. ↵
    1. Petersen Mitchell A

    2009. “Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches.” Review of Financial Studies 22(1):435–80.

    OpenUrlCrossRefWeb of Science
64. ↵
    1. Pfeffermann Daniel,
    2. Nathan Gaf

    1981. “Regression Analysis of Data from a Cluster Sample.” Journal American Statistical Association 76(375):681–89.

    OpenUrl
65. ↵
    1. Rabe-Hesketh Sophia,
    2. Skrondal Anders

    2012. Multilevel and Longitudinal Modeling Using Stata, Volumes I and II, Third Edition. College Station: Stata Press.
66. ↵
    1. Rogers William H

    1993. “Regression Standard Errors in Clustered Samples.” Stata Technical Bulletin 13:19–23.

    OpenUrl
67. ↵
    1. Satterthwaite F. E

    1946. “An Approximate Distribution of Estimates of Variance Components.” Biometrics Bulletin 2(6):110–14.

    OpenUrlCrossRefPubMedWeb of Science
68. ↵
    1. Schaffer Mark E.,
    2. Stillman Steven

    2010. “xtoverid: Stata Module to Calculate Tests of Overidentifying Restrictions after xtreg, xtivreg, xtivreg2 and xthtaylor.” http://ideas.repec.org/c/boc/bocode/s456779.html
69. ↵
    1. Scott A.J.,
    2. Holt D.

    1982. “The Effect of Two-Stage Sampling on Ordinary Least Squares Methods.” Journal American Statistical Association 77(380):848–54.

    OpenUrl
70. ↵
    1. Shah Bbabubhai V.,
    2. Holt M.M.,
    3. Folsom Ralph E.

    1977. “Inference About Regression Models from Sample Survey Data.” Bulletin of the International Statistical Institute Proceedings of the 41st Session 47(3):43–57.

    OpenUrl
71. ↵
    1. Shore-Sheppard L.

    1996. “The Precision of Instrumental Variables Estimates with Grouped Data.” Princeton University Industrial Relations Section Working Paper 374.
72. ↵
    1. Solon Gary,
    2. Haider Steven J.,
    3. Wooldridge Jeffrey

    2013. “What Are We Weighting For?” NBER Working Paper 18859.
73. ↵
    1. Staiger Douglas,
    2. Stock James H.

    1997. “Instrumental Variables Regression with Weak Instruments.” Econometrica 65:557–86.

    OpenUrlCrossRefPubMedWeb of Science
74. ↵
    1. Stock James H.,
    2. Watson Mark W.

    2008. “Heteroskedasticity-robust Standard Errors for Fixed Effects Panel Data Regression.” Econometrica 76(1):155–74.

    OpenUrlCrossRefWeb of Science
75. ↵
    1. Stock James H.,
    2. Yogo M.

    2005. “Testing for Weak Instruments in Linear IV Regressions.” In Identification and Inference for Econometric Models, ed. Andrews Donald W.K., Stock James H., 80–108. Cambridge: Cambridge University Press.
76. ↵
    1. Thompson Samuel

    . 2006. “Simple Formulas for Standard Errors that Cluster by Both Firm and Time.” SSRN paper. http://ssrn.com/abstract=914002.
77. ↵
    1. Thompson Samuel

    2011. “Simple Formulas for Standard Errors that Cluster by Both Firm and Time.” Journal of Financial Economics 99(1):1–10.

    OpenUrlCrossRefWeb of Science
78. ↵
    1. Webb Matthew D

    . 2013. “Reworking Wild Bootstrap Based Inference for Clustered Errors.” Queens Economics Department Working Paper 1315.
79. ↵
    1. White Halbert

    1980. “A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity.” Econometrica 48(4):817–38.

    OpenUrlCrossRefWeb of Science
80. ↵
    1. White Halbert

    1984. Asymptotic Theory for Econometricians. San Diego: Academic Press
81. ↵
    1. Wooldridge Jeffrey M.

    2003. “Cluster-Sample Methods in Applied Econometrics.” American Economic Review 93(2):133–38.

    OpenUrlCrossRef
82. 1. White Halbert

    . 2006. “Cluster-Sample Methods in Applied Econometrics: An Extended Analysis.” Michigan State University. Unpublished. http://econ.ucsb.edu/~doug/245a/Papers/Cluster%20Sample%20Methods%20in%20Applied%20Econometrics.pdf
83. 1. White Halbert

    . 2010. Econometric Analysis of Cross Section and Panel Data. Cambridge: MIT Press.
84. ↵
    1. Yoon Jungmo,
    2. Galvao Antonio

    2013. “Robust Inference for Panel Quantile Regression Models with Individual Effects and Serial Correlation.” Unpublished.