Evaluation Activities

  • The study will begin in spring 2021 and conclude in spring 2025. During this time, the evaluation will track implementation of NTC coaching in treatment schools over three school years and assess impact of NTC coaching at the end of the second and third years. In winter 2025, the evaluation will collect data on implementation in delayed treatment schools to inform scaling of the coaching model.
     
    Evaluation activities at each school will include (also shown in table below):
    • Random assignment & study sample: In late spring 2021, SRI will randomly assign all schools in the study to treatment or delayed treatment. All ELA and math teachers in treatment schools will participate in coaching, either one-on-one or as a member of a PLC. 
    • Teacher rosters: In fall 2021, fall 2022, and fall 2023, SRI will collect teacher rosters from each district for both treatment and delayed treatment schools, in order to identify study teachers and facilitate data collection. 
    • Teacher surveys (treatment and delayed treatment): In spring 2022, spring 2023, spring 2024, and spring 2025 NTC will administer surveys to teachers in both treatment and delayed treatment schools to collect data on coaching experiences, including frequency and focus of teacher-coach interactions. 
    • Coach surveys (treatment and delayed treatment): In spring 2022, spring 2023, spring 2024, and spring 2025, NTC will survey treatment coaches. SRI will administer a brief survey to coaches in delayed treatment schools to collect the names of teachers on 1:1 and PLC caseloads.  
    • TRIPOD student surveys: SRI will contract with Tripod Education Partners to administer its Social Emotional Learning Competencies (SEL-C) and Seven C’s student surveys in fall 2021 (baseline), spring 2023 and spring 2024. All students in grades 3-8 will complete the surveys, although parents will be notified and will have the option to opt students out of this activity. 
    • Interviews: In winter 2022, winter 2023, and winter 2024, SRI will interview a sample of teachers, coaches, principals, and district-level personnel to assess how the NTC model is implemented locally.

    SRI will communicate with principals in advance about each round of data collection. SRI will recruit local site research coordinators to support TRIPOD survey administration and will offer school and/or teacher incentives for participation in each data collection activity. SRI will request student achievement data from the Minnesota state longitudinal data system to collect student achievement and demographic data to evaluate impacts on student achievement.

    Confidentiality: SRI is dedicated to maintaining the confidentiality of participant information and the protection of human subjects. Surveys, observations, and interviews are voluntary and confidential. All data will be used only in the aggregate to assess NTC’s impact on teachers and students. SRI will comply with all district policies related to external research and will complete requests for teacher and student data in accordance with state and district data sharing and data use policies.

Evaluation Activities Timeline

Evaluation Activities Timeline