Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Archive
    • Supplementary Material
    • Free Issue
    • Special Issues
  • Info for
    • Authors
    • Subscribers
    • Institutions
    • Advertisers
  • About Us
    • About Us
    • Editorial Board
  • Connect
    • Feedback
    • Help
    • Request JHR at your library
    • Alerts
  • Announcements
  • Special Issue
  • Other Publications
    • UW Press Journals

User menu

  • Register
  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Human Resources
  • Other Publications
    • UW Press Journals
  • Register
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Human Resources

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Archive
    • Supplementary Material
    • Free Issue
    • Special Issues
  • Info for
    • Authors
    • Subscribers
    • Institutions
    • Advertisers
  • About Us
    • About Us
    • Editorial Board
  • Connect
    • Feedback
    • Help
    • Request JHR at your library
    • Alerts
  • Announcements
  • Special Issue
  • Follow uwp on Twitter
  • Follow JHR on Bluesky
Research ArticleArticles

Beyond Levels and Growth

Estimating Teacher Value-Added and its Persistence

Josh Kinsler
Journal of Human Resources, July 2012, 47 (3) 722-753; DOI: https://doi.org/10.3368/jhr.47.3.722
Josh Kinsler
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • References
  • PDF
Loading

Article Figures & Data

Tables

    • View popup
    table 1

    Estimating Variance in Teacher Ability using Misspecified Levels and Growth Models

    True Persistence of Teacher Ability: δ = 0.5
    Model Typeρ(Tjg ,Tj ,g + 1)Embedded Image Embedded Image Embedded Image Embedded Image
    0.0630.0620.0630.063
    Levels—(δ = 0)0.000.0540.0420.0520.068
    0.120.0570.0400.0570.075
    0.250.0630.0400.0640.085
    0.580.1070.0620.1150.146
    −0.120.0520.0450.0490.062
    −0.250.0500.0470.0450.057
    −0.580.0530.0620.0420.055
    Growth—(δ = 1)0.000.0660.0620.0670.068
    0.120.0600.0620.0590.058
    0.250.0550.0620.0530.049
    0.580.0480.0620.0420.038
    −0.120.0700.0620.0750.072
    −0.250.0750.0620.0850.077
    −0.580.0900.0620.1150.092

    Note: Results are averages over 500 simulations. Generated sample contains 25 schools, 3 grades per school, and 4 teachers per grade. Each teacher is observed with 50 students. Student and teacher ability are unobserved. Grades are generated according to a cumulative achievement equation where teacher inputs persist at a constant geometric rate equal to 0.5. Students are observed four times, first without any associated teacher, and then once in each grade. There is no additional measurement error in the model so that any biases stem entirely from model misspecification. Teacher and student populations are held fixed across the simulations, with only the within school sorting of students to teachers changing. Tjg is the ability of teacherjin gradeg. ρ(Tjg ,Tj ,g + 1) is the correlation in teacher quality across grades. σ2T is the true variance of teacher ability across all grades, while Embedded Image is the true variance of ability for third grade teachers only. The levels model implicitly assumes a persistence rate of 0 while the growth model implicitly assumes a persistence rate of 1. Bold-faced numbers reflect true underlying distributions.

      • View popup
      table 2

      Monte Carlo Evidence for Various Accumulation Models

      BaselineNongeometric PersistenceVarying Teacher Quality
      Teacher Persistence0.3490.350
      (0.024)(0.022)
      [0.35][0.35]
      One-period persistence0.351
      (0.024)
      [0.35]
      Two-period persistence0.039
      (0.039)
      [0.05]
      Less than two years experience−0.251
      (0.026)
      [−0.25]
      Between 3 and 5 years experience−0.101
      (0.017)
      [−0.1]
      Lag student transfer0.228
      (0.158)
      [0.25]
      Student transfer0.151
      (0.016)
      [0.15]
      Embedded Image , Unadjusted0.0760.0800.077
      Embedded Image , Adjusted0.0620.0650.062
      [0.062][0.065][0.062]
      R-square0.860.850.85
      Test-score observations35,60435,70935,616
      Students10,50010,50010,500
      Teachers839875813

      Note: Results are averages across 250 simulations. Standard deviations across the simulations are included in parentheses. True parameter values are included in brackets. Embedded Image is the estimated variation in teacher quality across all grades. Data generation for the Monte Carlos is described in detail in Section IIIC. The three panels of results reflect three different underlying data generating processes. All models include unobserved student ability and unobserved teacher ability in addition to the parameters listed in the table. Across all three models, the average, median, and minimum number of student observations per teacher are approximately 31, 20, and 9. Estimation follows the procedures discussed in Section IIIB.

        • View popup
        table 3

        Summary Statistics: North Carolina Elementary Students and Teacher

        MathReading
        Teacher statistics
        Total teachers38,78238,757
        Average observations per teacher63.7563.6
        Median observations per teacher2424
        Teacher experience12.7312.73
        Less than 5 years of experience0.320.32
        Graduate degree0.260.26
        Student statistics
        Total students689,641687,445
        Average observations per student3.583.58
        Nonwhite0.400.39
        Class size22.922.9
        Repeat0.010.01
        Transfer0.040.04
        Missing scores0.0030.003
        Pretest score0.120.12
        (0.97)(0.99)
        Grade 3 Test Score0.170.02
        (0.94)(0.99)
        Grade 4 Test Score0.20.04
        (0.97)(0.98)
        Grade 5 Test Score0.180.07
        (0.097)(0.91)

        Note: Sample is constructed using cohorts of North Carolina third grade students who enter between 1998 and 2005. Sample selection is discussed in Section IV. Overall, close to three-quarters of the entire universe of students who ever attend third through fifth grade between 1998 and 2007 are included. Math and reading end-of-grade exams are available at the end of third, fourth, and fifth grade. In addition, a pretest score is available from the beginning of third grade. Scores are normalized using the means and standard deviations of test scores in standard setting years as suggested by the North Carolina Department of Instruction. Observations per Teacher indicate the number of student test scores associated with a particular teacher. Graduate degree is an indicator that a teacher received any advanced degree. Repeat is an indicator that a student is repeating the current grade. Transfers indicate that the student is new to the current school.

          • View popup
          table 4

          Evidence of Student and Teacher Sorting in NC

          MathReading
          PopulationWithin-SchoolWithin-TeacherPopulationWithin-SchoolWithin-Teacher
          Third Grade School/Teacher Assignments
          Standard deviation third grade score0.9130.8570.8170.9570.9070.881
          Standard deviation lag score0.9520.8970.8680.9800.9370.910
          Fourth Grade School/Teacher Assignments
          Standard deviation fourth grade score0.9590.8980.8510.9600.9050.878
          Standard deviation lag score0.9040.8470.8150.9440.8930.868
          Standard deviation pretest score0.9450.8910.8570.9750.9320.901
          Fifth Grade School/Teacher Assignments
          Standard deviation fifth grade score0.9610.8940.8530.8870.8340.807
          Standard deviation lag score0.9530.8940.8580.9500.8950.870
          Standard deviation pretest score0.9420.8890.8540.9720.9300.898

          Note: Sample is constructed using cohorts of North Carolina third grade students who enter between 1998 and 2005. Sample selection is discussed in Section IV. Overall, close to three-quarters of the entire universe of students who ever attend third through fifth grade between 1998 and 2007 are included. Math and reading end-of-grade exams are available at the end of third, fourth, and fifth grade. In addition, a pretest score is available from the beginning of third grade. Scores are normalized using the means and standard deviations of test scores in standard setting years as suggested by the North Carolina Department of Instruction. The standard deviations within each section are taken with respect to the group identified in the heading. Note that the population standard deviation of the third grade score does not equal exactly the population standard deviation of the lag score using the fourth grade assignment. This simply reflects that not every individual observed in third grade is also observed in fourth grade.

            • View popup
            table 5

            Estimates of Baseline Accumulation, Levels, and Growth Models Using NC Data

            AccumulationLevels ModelGrowth Model
            Math Outcomes
            Teacher Persistence0.37501
            (0.007)——
            Embedded Image , Unadjusted0.06760.06350.0726
            Embedded Image , Adjusted0.05700.05470.0607
            Embedded Image , Adjusted0.05460.04590.0550
            Embedded Image , Adjusted0.06280.05770.0648
            Embedded Image , Adjusted0.05070.06010.0536
            Observations2,472,2522,472,2521,772,197
            R-square0.860.860.14
            Adjusted R-square0.800.800.12
            Students689,641689,641688,573
            Teachers38,78238,78238,567
            Reading Outcomes
            Teacher Persistence0.31701
            0.016——
            Embedded Image , Unadjusted0.03440.03220.0380
            Embedded Image , Adjusted0.02040.02070.0219
            Embedded Image , Adjusted0.02880.02330.0305
            Embedded Image , Adjusted0.01800.01960.0157
            Embedded Image , Adjusted0.01250.01870.0112
            Observations2,463,0932,463,0931,762,790
            R-square0.830.830.06
            Adjusted R-square0.760.760.04
            Students687,445687,445686,055
            Teachers38,75738,75738,544

            Note: Sample is constructed using cohorts of North Carolina third grade students who enter between 1998 and 2005. Sample selection is discussed in Section IV. Overall, close to three-quarters of the entire universe of students who ever attend third through fifth grade between 1998 and 2007 are included. Math and reading end-of-grade exams are available at the end of third, fourth, and fifth grade. In addition a pretest score is available from the beginning of third grade. Scores are normalized using the means and standard deviations of test scores in standard setting years as suggested by the North Carolina Department of Instruction. The dependent variable is the normalized end of grade math or reading test score. The explanatory variables are unobserved student and teacher ability. In the accumulation model the rate at which past teacher inputs persist is estimated. Embedded Image is the estimated variation in teacher value-added across all grades, while Embedded Image , for example, is the estimated variance of teacher value-added among only third grade teachers. Standard errors are obtained through bootstrap.

              • View popup
              table 6

              Estimates of Extended Accumulation Models in NC: Math Outcomes

              Nongeometric Persistence RatesVarying Teacher Quality
              One period persistence0.371Teacher Persistence0.3254
              (0.006)(0.021)
              Long-term persistence0.188No experience−0.136
              (0.009)(0.0033)
              One or two years experience−0.0137
              (0.0032)
              Between 3 and 5 years experience0.0045(0.0021)
              Graduate degree−0.0268
              (0.0039)
              Class size−0.0073
              (0.0002)
              Transfer−0.0235
              (0.0019)
              Repeat0.677
              (0.0041)
              Lag repeat0.617
              (0.0051)
              Twice lagged repeat0.5726
              (0.006)
              Embedded Image , Unadjusted0.0683Embedded Image , Unadjusted0.0668
              Embedded Image , Adjusted0.0575Embedded Image , Adjusted0.0576
              Observations2,472,252Observations2,472,252
              R-square0.86R-square0.86
              Adjusted R-square0.80Adjusted R-square0.81
              Students689,641Students689,641
              Teachers38,782Teachers38,782

              Note: See previous table notes for sample information and Sections IIIB1 and IIIB2 for model details. Embedded Image is the estimated variation in teacher value-added across all grades. Standard errors obtained by bootstrap.

                • View popup
                table 7

                Estimates of Extended Accumulation Models in NC: Reading Outcomes

                Nongeometric Persistence RatesVarying Teacher Quality
                One-period persistence0.293Teacher persistence0.4317
                (0.013)(0.019)
                Long-term persistence0.077No experience−0.1132
                (0.018)(0.0052)
                One or two years experience−0.0682
                (0.0031)
                Between 3 and 5 years experience−0.0332
                (0.0029)
                Graduate degree0.0346
                (0.0037)
                Class size−0.0049
                (0.0001)
                Transfer−0.0228
                (0.0026)
                Repeat0.5729
                (0.0049)
                Lag repeat0.5246
                (0.0053)
                Twice lagged repeat0.05467
                (0.0057)
                Embedded Image , Unadjusted0.0342Embedded Image , Unadjusted0.0344
                Embedded Image , Adjusted0.02Embedded Image , Adjusted0.0207
                Observations2,463,093Observations2,463,093
                R-square0.83R-square0.83
                Adjusted R-square0.76Adjusted R-square0.76
                Students687,445Students687,445
                Teachers38,757Teachers38,757

                Note: See previous table notes for sample information and Sections IIIB1 and IIIB2 for model details. Embedded Image is the estimated variation in teacher value-added across all grades. Standard errors obtained by bootstrap.

                PreviousNext
                Back to top

                In this issue

                Journal of Human Resources
                Vol. 47, Issue 3
                1 Jul 2012
                • Table of Contents
                • Table of Contents (PDF)
                • Index by author
                • Ed Board (PDF)
                Print
                Download PDF
                Article Alerts
                Sign In to Email Alerts with your Email Address
                Email Article

                Thank you for your interest in spreading the word on Journal of Human Resources.

                NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

                Enter multiple addresses on separate lines or separate them with commas.
                Beyond Levels and Growth
                (Your Name) has sent you a message from Journal of Human Resources
                (Your Name) thought you would like to see the Journal of Human Resources web site.
                Citation Tools
                Beyond Levels and Growth
                Josh Kinsler
                Journal of Human Resources Jul 2012, 47 (3) 722-753; DOI: 10.3368/jhr.47.3.722

                Citation Manager Formats

                • BibTeX
                • Bookends
                • EasyBib
                • EndNote (tagged)
                • EndNote 8 (xml)
                • Medlars
                • Mendeley
                • Papers
                • RefWorks Tagged
                • Ref Manager
                • RIS
                • Zotero
                Share
                Beyond Levels and Growth
                Josh Kinsler
                Journal of Human Resources Jul 2012, 47 (3) 722-753; DOI: 10.3368/jhr.47.3.722
                Twitter logo Facebook logo Mendeley logo
                • Tweet Widget
                • Facebook Like
                • Google Plus One
                Bookmark this article

                Jump to section

                • Article
                  • Abstract
                  • I. Introduction
                  • II. Persistence Assumptions and Estimates of Teacher Quality
                  • III. Estimating Persistence
                  • IV. Data
                  • V. Results
                  • VI. Conclusion
                  • Footnotes
                  • References
                • Figures & Data
                • Info & Metrics
                • References
                • PDF

                Related Articles

                • No related articles found.
                • Google Scholar

                Cited By...

                • No citing articles found.
                • Google Scholar

                More in this TOC Section

                • Selection into Public Service
                • Monopsony, Efficiency, and the Regularization of Undocumented Immigrants
                • Migration, Segregation, and Interracial Marriage
                Show more Articles

                Similar Articles

                UW Press logo

                © 2026 Board of Regents of the University of Wisconsin System

                Powered by HighWire