Article Figures & Data
Tables
- table 1
Estimating Variance in Teacher Ability using Misspecified Levels and Growth Models
True Persistence of Teacher Ability: δ = 0.5 Model Type ρ(Tjg ,Tj ,g + 1)
0.063 0.062 0.063 0.063 Levels—(δ = 0) 0.00 0.054 0.042 0.052 0.068 0.12 0.057 0.040 0.057 0.075 0.25 0.063 0.040 0.064 0.085 0.58 0.107 0.062 0.115 0.146 −0.12 0.052 0.045 0.049 0.062 −0.25 0.050 0.047 0.045 0.057 −0.58 0.053 0.062 0.042 0.055 Growth—(δ = 1) 0.00 0.066 0.062 0.067 0.068 0.12 0.060 0.062 0.059 0.058 0.25 0.055 0.062 0.053 0.049 0.58 0.048 0.062 0.042 0.038 −0.12 0.070 0.062 0.075 0.072 −0.25 0.075 0.062 0.085 0.077 −0.58 0.090 0.062 0.115 0.092 Note: Results are averages over 500 simulations. Generated sample contains 25 schools, 3 grades per school, and 4 teachers per grade. Each teacher is observed with 50 students. Student and teacher ability are unobserved. Grades are generated according to a cumulative achievement equation where teacher inputs persist at a constant geometric rate equal to 0.5. Students are observed four times, first without any associated teacher, and then once in each grade. There is no additional measurement error in the model so that any biases stem entirely from model misspecification. Teacher and student populations are held fixed across the simulations, with only the within school sorting of students to teachers changing. Tjg is the ability of teacherjin gradeg. ρ(Tjg ,Tj ,g + 1) is the correlation in teacher quality across grades. σ2T is the true variance of teacher ability across all grades, while
is the true variance of ability for third grade teachers only. The levels model implicitly assumes a persistence rate of 0 while the growth model implicitly assumes a persistence rate of 1. Bold-faced numbers reflect true underlying distributions. Baseline Nongeometric Persistence Varying Teacher Quality Teacher Persistence 0.349 0.350 (0.024) (0.022) [0.35] [0.35] One-period persistence 0.351 (0.024) [0.35] Two-period persistence 0.039 (0.039) [0.05] Less than two years experience −0.251 (0.026) [−0.25] Between 3 and 5 years experience −0.101 (0.017) [−0.1] Lag student transfer 0.228 (0.158) [0.25] Student transfer 0.151 (0.016) [0.15]
, Unadjusted0.076 0.080 0.077
, Adjusted0.062 0.065 0.062 [0.062] [0.065] [0.062] R-square 0.86 0.85 0.85 Test-score observations 35,604 35,709 35,616 Students 10,500 10,500 10,500 Teachers 839 875 813 Note: Results are averages across 250 simulations. Standard deviations across the simulations are included in parentheses. True parameter values are included in brackets.
is the estimated variation in teacher quality across all grades. Data generation for the Monte Carlos is described in detail in Section IIIC. The three panels of results reflect three different underlying data generating processes. All models include unobserved student ability and unobserved teacher ability in addition to the parameters listed in the table. Across all three models, the average, median, and minimum number of student observations per teacher are approximately 31, 20, and 9. Estimation follows the procedures discussed in Section IIIB.Math Reading Teacher statistics Total teachers 38,782 38,757 Average observations per teacher 63.75 63.6 Median observations per teacher 24 24 Teacher experience 12.73 12.73 Less than 5 years of experience 0.32 0.32 Graduate degree 0.26 0.26 Student statistics Total students 689,641 687,445 Average observations per student 3.58 3.58 Nonwhite 0.40 0.39 Class size 22.9 22.9 Repeat 0.01 0.01 Transfer 0.04 0.04 Missing scores 0.003 0.003 Pretest score 0.12 0.12 (0.97) (0.99) Grade 3 Test Score 0.17 0.02 (0.94) (0.99) Grade 4 Test Score 0.2 0.04 (0.97) (0.98) Grade 5 Test Score 0.18 0.07 (0.097) (0.91) Note: Sample is constructed using cohorts of North Carolina third grade students who enter between 1998 and 2005. Sample selection is discussed in Section IV. Overall, close to three-quarters of the entire universe of students who ever attend third through fifth grade between 1998 and 2007 are included. Math and reading end-of-grade exams are available at the end of third, fourth, and fifth grade. In addition, a pretest score is available from the beginning of third grade. Scores are normalized using the means and standard deviations of test scores in standard setting years as suggested by the North Carolina Department of Instruction. Observations per Teacher indicate the number of student test scores associated with a particular teacher. Graduate degree is an indicator that a teacher received any advanced degree. Repeat is an indicator that a student is repeating the current grade. Transfers indicate that the student is new to the current school.
Math Reading Population Within-School Within-Teacher Population Within-School Within-Teacher Third Grade School/Teacher Assignments Standard deviation third grade score 0.913 0.857 0.817 0.957 0.907 0.881 Standard deviation lag score 0.952 0.897 0.868 0.980 0.937 0.910 Fourth Grade School/Teacher Assignments Standard deviation fourth grade score 0.959 0.898 0.851 0.960 0.905 0.878 Standard deviation lag score 0.904 0.847 0.815 0.944 0.893 0.868 Standard deviation pretest score 0.945 0.891 0.857 0.975 0.932 0.901 Fifth Grade School/Teacher Assignments Standard deviation fifth grade score 0.961 0.894 0.853 0.887 0.834 0.807 Standard deviation lag score 0.953 0.894 0.858 0.950 0.895 0.870 Standard deviation pretest score 0.942 0.889 0.854 0.972 0.930 0.898 Note: Sample is constructed using cohorts of North Carolina third grade students who enter between 1998 and 2005. Sample selection is discussed in Section IV. Overall, close to three-quarters of the entire universe of students who ever attend third through fifth grade between 1998 and 2007 are included. Math and reading end-of-grade exams are available at the end of third, fourth, and fifth grade. In addition, a pretest score is available from the beginning of third grade. Scores are normalized using the means and standard deviations of test scores in standard setting years as suggested by the North Carolina Department of Instruction. The standard deviations within each section are taken with respect to the group identified in the heading. Note that the population standard deviation of the third grade score does not equal exactly the population standard deviation of the lag score using the fourth grade assignment. This simply reflects that not every individual observed in third grade is also observed in fourth grade.
Accumulation Levels Model Growth Model Math Outcomes Teacher Persistence 0.375 0 1 (0.007) — —
, Unadjusted0.0676 0.0635 0.0726
, Adjusted0.0570 0.0547 0.0607
, Adjusted0.0546 0.0459 0.0550
, Adjusted0.0628 0.0577 0.0648
, Adjusted0.0507 0.0601 0.0536 Observations 2,472,252 2,472,252 1,772,197 R-square 0.86 0.86 0.14 Adjusted R-square 0.80 0.80 0.12 Students 689,641 689,641 688,573 Teachers 38,782 38,782 38,567 Reading Outcomes Teacher Persistence 0.317 0 1 0.016 — —
, Unadjusted0.0344 0.0322 0.0380
, Adjusted0.0204 0.0207 0.0219
, Adjusted0.0288 0.0233 0.0305
, Adjusted0.0180 0.0196 0.0157
, Adjusted0.0125 0.0187 0.0112 Observations 2,463,093 2,463,093 1,762,790 R-square 0.83 0.83 0.06 Adjusted R-square 0.76 0.76 0.04 Students 687,445 687,445 686,055 Teachers 38,757 38,757 38,544 Note: Sample is constructed using cohorts of North Carolina third grade students who enter between 1998 and 2005. Sample selection is discussed in Section IV. Overall, close to three-quarters of the entire universe of students who ever attend third through fifth grade between 1998 and 2007 are included. Math and reading end-of-grade exams are available at the end of third, fourth, and fifth grade. In addition a pretest score is available from the beginning of third grade. Scores are normalized using the means and standard deviations of test scores in standard setting years as suggested by the North Carolina Department of Instruction. The dependent variable is the normalized end of grade math or reading test score. The explanatory variables are unobserved student and teacher ability. In the accumulation model the rate at which past teacher inputs persist is estimated.
is the estimated variation in teacher value-added across all grades, while
, for example, is the estimated variance of teacher value-added among only third grade teachers. Standard errors are obtained through bootstrap.Nongeometric Persistence Rates Varying Teacher Quality One period persistence 0.371 Teacher Persistence 0.3254 (0.006) (0.021) Long-term persistence 0.188 No experience −0.136 (0.009) (0.0033) One or two years experience −0.0137 (0.0032) Between 3 and 5 years experience 0.0045 (0.0021) Graduate degree −0.0268 (0.0039) Class size −0.0073 (0.0002) Transfer −0.0235 (0.0019) Repeat 0.677 (0.0041) Lag repeat 0.617 (0.0051) Twice lagged repeat 0.5726 (0.006)
, Unadjusted0.0683
, Unadjusted0.0668
, Adjusted0.0575
, Adjusted0.0576 Observations 2,472,252 Observations 2,472,252 R-square 0.86 R-square 0.86 Adjusted R-square 0.80 Adjusted R-square 0.81 Students 689,641 Students 689,641 Teachers 38,782 Teachers 38,782 Note: See previous table notes for sample information and Sections IIIB1 and IIIB2 for model details.
is the estimated variation in teacher value-added across all grades. Standard errors obtained by bootstrap.Nongeometric Persistence Rates Varying Teacher Quality One-period persistence 0.293 Teacher persistence 0.4317 (0.013) (0.019) Long-term persistence 0.077 No experience −0.1132 (0.018) (0.0052) One or two years experience −0.0682 (0.0031) Between 3 and 5 years experience −0.0332 (0.0029) Graduate degree 0.0346 (0.0037) Class size −0.0049 (0.0001) Transfer −0.0228 (0.0026) Repeat 0.5729 (0.0049) Lag repeat 0.5246 (0.0053) Twice lagged repeat 0.05467 (0.0057)
, Unadjusted0.0342
, Unadjusted0.0344
, Adjusted0.02
, Adjusted0.0207 Observations 2,463,093 Observations 2,463,093 R-square 0.83 R-square 0.83 Adjusted R-square 0.76 Adjusted R-square 0.76 Students 687,445 Students 687,445 Teachers 38,757 Teachers 38,757 Note: See previous table notes for sample information and Sections IIIB1 and IIIB2 for model details.
is the estimated variation in teacher value-added across all grades. Standard errors obtained by bootstrap.



































