-
Designing Visual Learning Analytics for Supporting Equity in STEM Classrooms
Authors:
Ali Raza,
William R. Penuel,
Tamara Sumner
Abstract:
Supporting equitable instruction is an important issue for teachers attending diverse STEM classrooms. Visual learning analytics along with effective student survey measures can support providing on time feedback to teachers in making instruction more culturally relevant to all students. We adopted a user-centered approach, where we engaged seven middle school science teachers in iterative testing…
▽ More
Supporting equitable instruction is an important issue for teachers attending diverse STEM classrooms. Visual learning analytics along with effective student survey measures can support providing on time feedback to teachers in making instruction more culturally relevant to all students. We adopted a user-centered approach, where we engaged seven middle school science teachers in iterative testing of thirty data visualizations disaggregated over markers such as gender and race for implementation of selected displays in a visual learning analytics tool- Student Electronic Exit Ticket (SEET). This process helped us gather insights into teachers' sensemaking in identifying patterns of student data related to gender and race, selecting and improving the design of the feedback displays for the SEET [10].
△ Less
Submitted 14 January, 2024;
originally announced January 2024.
-
The TalkMoves Dataset: K-12 Mathematics Lesson Transcripts Annotated for Teacher and Student Discursive Moves
Authors:
Abhijit Suresh,
Jennifer Jacobs,
Charis Harty,
Margaret Perkoff,
James H. Martin,
Tamara Sumner
Abstract:
Transcripts of teaching episodes can be effective tools to understand discourse patterns in classroom instruction. According to most educational experts, sustained classroom discourse is a critical component of equitable, engaging, and rich learning environments for students. This paper describes the TalkMoves dataset, composed of 567 human-annotated K-12 mathematics lesson transcripts (including…
▽ More
Transcripts of teaching episodes can be effective tools to understand discourse patterns in classroom instruction. According to most educational experts, sustained classroom discourse is a critical component of equitable, engaging, and rich learning environments for students. This paper describes the TalkMoves dataset, composed of 567 human-annotated K-12 mathematics lesson transcripts (including entire lessons or portions of lessons) derived from video recordings. The set of transcripts primarily includes in-person lessons with whole-class discussions and/or small group work, as well as some online lessons. All of the transcripts are human-transcribed, segmented by the speaker (teacher or student), and annotated at the sentence level for ten discursive moves based on accountable talk theory. In addition, the transcripts include utterance-level information in the form of dialogue act labels based on the Switchboard Dialog Act Corpus. The dataset can be used by educators, policymakers, and researchers to understand the nature of teacher and student discourse in K-12 math classrooms. Portions of this dataset have been used to develop the TalkMoves application, which provides teachers with automated, immediate, and actionable feedback about their mathematics instruction.
△ Less
Submitted 6 April, 2022;
originally announced April 2022.
-
3DARVisualizer: Debugging 3D Models using Augmented Reality
Authors:
Srinjita Bhaduri,
Peter Gyory,
Tamara Sumner
Abstract:
Often neglected in traditional education, spatial thinking has played a critical role in science, technology, engineering, and mathematics (STEM) education. Spatial thinking skills can be enhanced by training, life experience, and practice. One approach to train these skills is through 3D modeling (also known as Computer-Aided Design or CAD). Although 3D modeling tools have shown promising results…
▽ More
Often neglected in traditional education, spatial thinking has played a critical role in science, technology, engineering, and mathematics (STEM) education. Spatial thinking skills can be enhanced by training, life experience, and practice. One approach to train these skills is through 3D modeling (also known as Computer-Aided Design or CAD). Although 3D modeling tools have shown promising results in training and enhancing spatial thinking skills in undergraduate engineering students when it comes to novices, especially middle and high-school students, they are not sufficient to provide rich 3D experience since the 3D models created in CAD are isolated the actual 3D physical world. Resulting in novice students finding it difficult to create error-free 3D models that would 3D print successfully. This leads to student frustration where students are not motivated to create 3D models themselves; instead, they prefer to download them from online repositories. To address this problem, researchers are focusing on integrating 3D models and displays into the physical world with the help of technologies like Augmented Reality (AR). In this demo, we present an AR application, 3DARVisualizer, that helps us explore the role of AR as a 3D model debugger, including enhancing 3D modeling abilities and spatial thinking skills of middle- and high-school students.
△ Less
Submitted 1 June, 2021; v1 submitted 22 May, 2021;
originally announced May 2021.
-
Using Transformers to Provide Teachers with Personalized Feedback on their Classroom Discourse: The TalkMoves Application
Authors:
Abhijit Suresh,
Jennifer Jacobs,
Vivian Lai,
Chenhao Tan,
Wayne Ward,
James H. Martin,
Tamara Sumner
Abstract:
TalkMoves is an innovative application designed to support K-12 mathematics teachers to reflect on, and continuously improve their instructional practices. This application combines state-of-the-art natural language processing capabilities with automated speech recognition to automatically analyze classroom recordings and provide teachers with personalized feedback on their use of specific types o…
▽ More
TalkMoves is an innovative application designed to support K-12 mathematics teachers to reflect on, and continuously improve their instructional practices. This application combines state-of-the-art natural language processing capabilities with automated speech recognition to automatically analyze classroom recordings and provide teachers with personalized feedback on their use of specific types of discourse aimed at broadening and deepening classroom conversations about mathematics. These specific discourse strategies are referred to as "talk moves" within the mathematics education community and prior research has documented the ways in which systematic use of these discourse strategies can positively impact student engagement and learning. In this article, we describe the TalkMoves application's cloud-based infrastructure for managing and processing classroom recordings, and its interface for providing teachers with feedback on their use of talk moves during individual teaching episodes. We present the series of model architectures we developed, and the studies we conducted, to develop our best-performing, transformer-based model (F1 = 79.3%). We also discuss several technical challenges that need to be addressed when working with real-world speech and language data from noisy K-12 classrooms.
△ Less
Submitted 29 April, 2021;
originally announced May 2021.
