On November 4th, the sub-forum, “Research on Generative Artificial Intelligence and Language Assessment – Multivariate Generalizability Theory Approach”, part of the 10th Forum on Empirical Education Research, was successfully conducted in Room 1806 of the Sanjiang Building at Jiangsu University. This event was hosted by East China Normal University and organized by the School of Teacher Education and the Evidence-Based Education Assessment Research Center of Jiangsu University. The conference was held in a hybrid format, integrating online and in-person participation.
Initially, Professor Jiajia Wang, Dean of the School of Teacher Education at Jiangsu University, presented an inaugural address. Dean Wang presented an overview of the School of Teacher Education and the Evidence-Based Education Assessment Research Center at Jiangsu University, along with the achievements of Professor Jinyan Huang’s team in empirical education research. He recognized the importance of this platform and offered a perspective on the future advancement of empirical education research.
The initial segment of the forum was presided over by Teacher Guanghui Shen. Professor Huang Jinyan presented a report entitled "Generative Artificial Intelligence and Language Assessment: A Multivariate Generalizability Theory Approach." Professor Huang commenced by emphasizing the difficulties encountered in conventional language testing. He subsequently introduced and elucidated generalizability theory, followed by a detailed discussion on the research methodologies, design, software use, and practical applications of multivariate generalizability theory, exemplified by specific situations and his study. Finally, he underscored the vast potential for using generative artificial intelligence in language evaluation and examined prospective research avenues in AI-driven language assessment and generalizability theory.
The latter portion of the forum was chaired by Professor Yingliang Liu from Wuhan University of Technology. Teacher Junfei Li from Shanghai DianJi University, Dr Qiren Zhang from Yunnan University, and students Rong Wang, Yuehan Wang, and Ying Liu from Jiangsu University presented specialized reports entitled 'AI vs. Peer Assessment in English L2 Speaking Classrooms, AI vs. Teacher Assessment in English L2 Writing Classrooms, AI vs. Teacher Assessment in Chinese L2 Writing Classrooms, AI vs. Human Assessors in Large-Scale English L1 Writing Assessment, and AI vs. Teacher Assessment in English L2 Speaking Classrooms.'
The discussion session following the special reports was chaired by Professor Yingliang Liu from Wuhan University of Technology. Participants deliberated on the appropriate utilization of ChatGPT and regulatory frameworks for AI writing, prompting educators and students to contemplate the future evolution of artificial intelligence in education. Vice Dean Cui Kang from the School of Teacher Education at Jiangsu University concluded the event with a speech summarising the discussions and offering a perspective on future developments. Teacher Shuo Zhao presided over the session.
Consequently, the sub-forum has been effectively concluded.
