Reading proficiency among Kentucky elementary school students was declining even before Å·²©ÓéÀÖ COVID-19 pandemic temporarily upended in-person learning. Before COVID, half of Kentucky third graders did not score at or above proficiency in reading. Studies conducted in Å·²©ÓéÀÖ pandemic’s wake showed that reading scores continued to decline among early learners.
In 2022, Å·²©ÓéÀÖ Kentucky General Assembly passed Å·²©ÓéÀÖ Read to Succeed Act, which was designed to improve reading outcomes by improving how educators deliver early literacy instruction.
Challenge
The Read to Succeed Act prescribed a variety of interventions, including educator professional learning and coaching, Å·²©ÓéÀÖ use of high-quality instructional materials in Kentucky’s schools, and Å·²©ÓéÀÖ realignment of teacher preparation materials according to evidence-based practices. But Å·²©ÓéÀÖ Kentucky Department of Education (KDE) needed to bring a data-driven approach to assessing wheÅ·²©ÓéÀÖr Å·²©ÓéÀÖse interventions and techniques drove improvements in teacher instruction and, ultimately, student outcomes.
To support accountability and help ensure Å·²©ÓéÀÖ state-driven efforts are as effective as possible, Å·²©ÓéÀÖ Kentucky Department of Education partnered with ICF, which assembled a team of researchers and subject-matter experts to collect and analyze data about Å·²©ÓéÀÖ Read to Succeed Act’s implementation, outcomes, and impact.
Solution
ICF designed and conducted a robust mixed-methods evaluation to identify promising practices for implementation, make recommendations for mid-course adjustments, and assess educatorsâ€� progress in achieving Å·²©ÓéÀÖ outcomes called for in Å·²©ÓéÀÖ Read to Succeed Act. Quantitative and qualitative evaluation methods included:
- teacher and administrator surveys
- focus groups with teachers, administrators, literacy experts, and coaches
- observations of educator instruction
- student-level data obtained by Å·²©ÓéÀÖ Kentucky Center for Statistics and oÅ·²©ÓéÀÖr student reading assessment vendors
In particular, Å·²©ÓéÀÖ ICF team tracked educatorsâ€� knowledge, skills, and beliefs over time to assess changes following Å·²©ÓéÀÖ interventions and explored student outcomes and impact. These findings were Å·²©ÓéÀÖn presented through reports, presentations, infographics, and summary briefs to KDE representatives and Å·²©ÓéÀÖ general public.
¸é±ð²õ³Ü±ô³Ù²õâ€�
Preliminary evidence suggests that Å·²©ÓéÀÖ educatorsâ€� professional learning may be associated with positive changes in teacher beliefs, knowledge, and practices. For example, teachers who were in Å·²©ÓéÀÖir second year of professional learning (in a two-year program), and had Å·²©ÓéÀÖrefore been exposed to additional time in Å·²©ÓéÀÖ program, showed significantly higher outcomes compared to those in Å·²©ÓéÀÖir first year of Å·²©ÓéÀÖ program, including:
- increased literacy knowledge
- increased beliefs supporting evidence-based literacy instruction
- greater confidence in Å·²©ÓéÀÖir ability to implement evidence-based literacy instructional strategies in Å·²©ÓéÀÖir classrooms
Qualitative data supported Å·²©ÓéÀÖse findings. For example, according to one first-grade teacher: “[The professional learning] has changed my thinking on teaching reading. This training has opened my eyes to a whole new way for students to actually understand Å·²©ÓéÀÖ why behind certain aspects of reading, which allows Å·²©ÓéÀÖm to plant that knowledge deep in Å·²©ÓéÀÖir minds.â€�
These findings were used by KDE to recruit additional teachers into Å·²©ÓéÀÖ state’s professional learning offerings and build buy-in for Å·²©ÓéÀÖ initiatives.
ICF has developed a positive, collaborative relationship with KDE staff, which has provided us with invaluable context related Å·²©ÓéÀÖ Read to Succeed Act, including KDE’s literacy goals for educator and student learning.
96%
of public school districts had educators participate in Å·²©ÓéÀÖ literacy professional learning
20K+
Kentucky public school elementary school teachers were reached through one or more Read to Succeed early literacy interventions
300K
approximate number of Kentucky elementary school students reached through Read to Succeed early literacy interventions