SBIR-STTR Award

Teachley Problem-Solving Assessment: Supporting Teachers to Assess and Promote Students' Mathematical Thinking
Award last edited on: 3/23/2023

Sponsored Program
SBIR
Awarding Agency
DoEd
Total Award Amount
$1,099,995
Award Phase
2
Solicitation Topic Code
91990020R0006
Principal Investigator
Rachael Labrecque

Company Information

Teachley LLC

25 Broadway FL 13 C/O Teach For America
New York, NY 10004
   (347) 552-1272
   info@teachley.com
   www.teachley.com
Location: Single
Congr. District: 11
County: Richmond

Phase I

Contract Number: 91990020C0071
Start Date: 6/9/2020    Completed: 2/15/2021
Phase I year
2020
Phase I Amount
$199,995
The project will develop a prototype of a formative assessment dashboard for teachers to view, monitor, and gain insight from students' digital work in mathematics to inform instruction. In Phase I, the team will develop a prototype of the formative assessment tool to support teachers' pedagogical approaches, identify areas for personalized intervention, and plan math discussions that address student misconceptions and support peer-to-peer learning. At the end of Phase I, in a pilot study with 3 fifth-grade teachers and 75 students, the researchers will examine whether the prototype functions as planned, if educators can use the prototype to track student progress, and if teachers believe that the prototype can facilitate formative assessment in ways that can sharpen instruction and deepen student learning.

Phase II

Contract Number: 91990021C0042
Start Date: 5/1/2021    Completed: 4/30/2023
Phase II year
2021
Phase II Amount
$900,000
Purpose: This project team will fully develop and test a product for educators that organizes and interprets student solutions in response to mathematical problems. Mathematical problem solving is at the heart of effective mathematics learning because it requires students to think deeply about content and employ higher-order thinking. However, assessing problem solving is difficult. Multiple choice questions only assess the final solution and ignore the process. When students do show their work when solving problems, work can often be messy, incomplete, and hard to follow, making it difficult for educators to analyze and assess. Project Activities: During Phase I in 2020, the team developed a prototype of a dashboard for teachers to view, monitor, and gain insight from students' digital work in mathematics to inform instruction. The prototype presents insights to support teachers' pedagogical approaches, identify areas for personalized intervention, and plan math discussions that address student misconceptions and support peer-to-peer learning. At the end of Phase I, researchers completed a pilot study with three grade 5 teachers and 75 students. Results demonstrated that the prototype functioned as planned, that educators could use the prototype to track student progress, and that teachers agreed that the prototype facilitated ways to sharpen instruction and deepen student learning. In Phase II, the team will fully develop a machine learning engine to automatically categorize student problem solving strategizes and provides insights to teachers, as well as training materials to support implementation. After development is complete, the research team will conduct a pilot study to assess the feasibility and usability, and promise of the product to support educators in understanding individual students' problem-solving strategies. The study will include 60 grade five classrooms, half will be randomly assigned the product and half will continue to use business as usual procedures. Researchers will employ a mixed-methods design to assess how educators use the product to inform instruction, including researcher developed interview protocols, teacher logs, classroom observations. To examine differences in students in treatment and control classrooms from pre- to post-test, researchers will employ items from the Mathematics Assessment Project and from NAEP items. Researchers will gather cost information using the "ingredients method" and will include all expenditures on things such as personnel, facilities, equipment, materials, and training. Product: Teachley Problem-Solving Assessment will organize and interpret student solutions in solving math problems. The product's dashboard will present insights to help teachers view, monitor, and assess student work to inform their instruction. The main components will include a machine learning engine will designed to generate automated prompts where students justify their work and a function that automatically categorizes, sorts, and presents student work, a user interface designed to cleanly present student work, and teacher professional development resources to implementation.