Skip to main content
Top

Open Access 22-03-2024 | COVID-19

Expanding Education Researchers’ Access to Classroom Observation Data With a Remote and Cost-Effective Video Data Collection Protocol

Authors: Leigh McLean, Paul Espinoza, Kati Tilley, Lori Foote, Nathan Jones, Ben Kelcey

Published in: Prevention Science

Login to get access

Abstract

The onset of the COVID-19 pandemic and associated long-term shifts to virtual instruction among most US schools presented notable challenges among education researchers. Ongoing projects conducted in school settings experienced sudden losses of access to teacher and student participants, in many cases leading to severe interruptions to data collection efforts. Perhaps most notably, upon returns to in-person instruction in the 2021/22 academic year most schools instigated strict policies limiting the number of non-school personnel who could enter school buildings, including researchers conducting in-person data collections. As such, many researchers had to find alternative means to gather data. In this paper, we offer a new protocol that we created in response to these challenges that allows for the secure and fully remote collection of video data in school settings. This new protocol not only addressed the immediate needs of the focal study but also addresses some of the most notable barriers to collecting classroom video data in the field of education research at large. In this paper, we describe the initial development and application of this protocol among a local study of elementary teachers, as well as the scaling of this protocol in a study of elementary teachers in multiple states. It is our hope that this protocol can expand education researchers’, practitioners’, and policymakers’ access to classroom video data.
Appendix
Available only for authorised users
Literature
go back to reference Bettini, E., Jones, N., Brownell, M., Conroy, M., Park, Y., Leite, W., . . . Benedict, A. (2017). Workload manageability among novice special and general educators: Relationships with emotional exhaustion and career intentions. Remedial and Special Education, 38(4), 246–256.CrossRef Bettini, E., Jones, N., Brownell, M., Conroy, M., Park, Y., Leite, W., . . . Benedict, A. (2017). Workload manageability among novice special and general educators: Relationships with emotional exhaustion and career intentions. Remedial and Special Education, 38(4), 246–256.CrossRef
go back to reference Casabianca, J. M., McCaffrey, D. F., Gitomer, D. H., Bell, C. A., Hamre, B. K., & Pianta, R. C. (2013). Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement, 73(5), 757–783.CrossRef Casabianca, J. M., McCaffrey, D. F., Gitomer, D. H., Bell, C. A., Hamre, B. K., & Pianta, R. C. (2013). Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement, 73(5), 757–783.CrossRef
go back to reference Cohen, J., & Goldhaber, D. (2016). Building a more complete understanding of teacher evaluation using classroom observations. Educational Researcher, 45(6), 378–387.CrossRef Cohen, J., & Goldhaber, D. (2016). Building a more complete understanding of teacher evaluation using classroom observations. Educational Researcher, 45(6), 378–387.CrossRef
go back to reference Diliberti, M., Schwartz, H. L., & Grant, D. M. (2021). Stress topped the reasons why public school teachers quit, even before COVID-19. Rand. Diliberti, M., Schwartz, H. L., & Grant, D. M. (2021). Stress topped the reasons why public school teachers quit, even before COVID-19. Rand.
go back to reference Haidet, K. K., Tate, J., Divirgilio-Thomas, D., Kolanowski, A., & Happ, M. B. (2009). Methods to improve reliability of video-recorded behavioral data. Research in Nursing & Health, 32(4), 465–474.CrossRef Haidet, K. K., Tate, J., Divirgilio-Thomas, D., Kolanowski, A., & Happ, M. B. (2009). Methods to improve reliability of video-recorded behavioral data. Research in Nursing & Health, 32(4), 465–474.CrossRef
go back to reference Hill, H., & Grossman, P. (2013). Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems. Harvard Educational Review, 83(2), 371–384.CrossRef Hill, H., & Grossman, P. (2013). Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems. Harvard Educational Review, 83(2), 371–384.CrossRef
go back to reference Jones, N. D., & Brownell, M. T. (2014). Examining the use of classroom observations in the evaluation of special education teachers. Assessment for Effective Intervention, 39(2), 112–124.CrossRef Jones, N. D., & Brownell, M. T. (2014). Examining the use of classroom observations in the evaluation of special education teachers. Assessment for Effective Intervention, 39(2), 112–124.CrossRef
go back to reference Kane, T., Kerr, K., & Pianta, R. (2014). Designing teacher evaluation systems: New guidance from the measures of effective teaching project. John Wiley & Sons. Kane, T., Kerr, K., & Pianta, R. (2014). Designing teacher evaluation systems: New guidance from the measures of effective teaching project. John Wiley & Sons.
go back to reference Kane, T. J., McCaffrey, D. F., Miller, T., & Staiger, D. O. (2013). Have we identified effective teachers? Validating measures of effective teaching using random assignment. Research paper. MET project. Bill & Melinda Gates Foundation. Kane, T. J., McCaffrey, D. F., Miller, T., & Staiger, D. O. (2013). Have we identified effective teachers? Validating measures of effective teaching using random assignment. Research paper. MET project. Bill & Melinda Gates Foundation.
go back to reference Kane, T. J., & Staiger, D. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Research paper. MET project. Bill & Melinda Gates Foundation. Kane, T. J., & Staiger, D. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Research paper. MET project. Bill & Melinda Gates Foundation.
go back to reference Kaufman, J. H., & Diliberti, M. K. (2021). Divergent and inequitable teaching and learning pathways during (and perhaps beyond) the pandemic: Key findings from the American educator panels spring 2021 COVID-19 surveys. RAND Corporation. Data note: Insights from the American educator panels. Research report. RR-A168-6. Kaufman, J. H., & Diliberti, M. K. (2021). Divergent and inequitable teaching and learning pathways during (and perhaps beyond) the pandemic: Key findings from the American educator panels spring 2021 COVID-19 surveys. RAND Corporation. Data note: Insights from the American educator panels. Research report. RR-A168-6.
go back to reference Kraft, M. A., & Monti-Nussbaum, M. (2021). The big problem with little interruptions to classroom learning. AERA Open, 7, 23328584211028856.CrossRef Kraft, M. A., & Monti-Nussbaum, M. (2021). The big problem with little interruptions to classroom learning. AERA Open, 7, 23328584211028856.CrossRef
go back to reference Lasagabaster, D., & Sierra, J. M. (2011). Classroom observation: Desirable conditions established by teachers. European Journal of Teacher Education, 34(4), 449–463.CrossRef Lasagabaster, D., & Sierra, J. M. (2011). Classroom observation: Desirable conditions established by teachers. European Journal of Teacher Education, 34(4), 449–463.CrossRef
go back to reference Lindorff, A., & Sammons, P. (2018). Going beyond structured observations: Looking at classroom practice through a mixed method lens. ZDM, 50, 521–534.CrossRef Lindorff, A., & Sammons, P. (2018). Going beyond structured observations: Looking at classroom practice through a mixed method lens. ZDM, 50, 521–534.CrossRef
go back to reference Marsh, B., & Mitchell, N. (2014). The role of video in teacher professional development. Teacher Development, 18(3), 403–417.CrossRef Marsh, B., & Mitchell, N. (2014). The role of video in teacher professional development. Teacher Development, 18(3), 403–417.CrossRef
go back to reference McLean, L., & Connor, C. M. (2018). Challenges, benefits, and considerations when conducting classroom video observation research. SAGE Publications Ltd.CrossRef McLean, L., & Connor, C. M. (2018). Challenges, benefits, and considerations when conducting classroom video observation research. SAGE Publications Ltd.CrossRef
go back to reference National Center for Education Statistics, National Assessment of Educational Progress: The Nation’s Report Card. (2022b). Washington, D.C: National Center for Education Statistics, Office of Educational Research and Improvement, US Dept. of Education. National Center for Education Statistics, National Assessment of Educational Progress: The Nation’s Report Card. (2022b). Washington, D.C: National Center for Education Statistics, Office of Educational Research and Improvement, US Dept. of Education.
go back to reference Paterson, B. L. (1994). A framework to identify reactivity in qualitative research. Western Journal of Nursing Research, 16(3), 301–316.CrossRefPubMed Paterson, B. L. (1994). A framework to identify reactivity in qualitative research. Western Journal of Nursing Research, 16(3), 301–316.CrossRefPubMed
go back to reference Postholm, M. B. (2012). Teachers’ professional development: A theoretical review. Educational Research, 54(4), 405–429.CrossRef Postholm, M. B. (2012). Teachers’ professional development: A theoretical review. Educational Research, 54(4), 405–429.CrossRef
go back to reference Pressley, T. (2021). Factors contributing to teacher burnout during COVID-19. Educational Researcher, 50(5), 325–327.CrossRef Pressley, T. (2021). Factors contributing to teacher burnout during COVID-19. Educational Researcher, 50(5), 325–327.CrossRef
go back to reference Walker, M., Worth, J., & Van den Brande, J. (2019). Teacher workload survey 2019. Walker, M., Worth, J., & Van den Brande, J. (2019). Teacher workload survey 2019.
Metadata
Title
Expanding Education Researchers’ Access to Classroom Observation Data With a Remote and Cost-Effective Video Data Collection Protocol
Authors
Leigh McLean
Paul Espinoza
Kati Tilley
Lori Foote
Nathan Jones
Ben Kelcey
Publication date
22-03-2024
Publisher
Springer US
Keyword
COVID-19
Published in
Prevention Science
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-024-01659-w