Virtual Brownbag with Dr. Peter Kim
Virtual Brownbag Lecture
Hosted by Studies in Applied Linguistics & TESOL
Teachers College, Columbia University Studies in Applied Linguistics & TESOL invites you to a Zoom lecture!
We are excited to welcome Dr. Peter Kim, senior researcher at Cambridge Boxhill Language Assessment.
The title of the talk is:
Unmasking the Machine: Methods for Identifying AI-generated Writing and Implications for Language Instruction
Date: Friday, March 8
Time: 2:00 - 3:00 pm (ET)
Venue: Zoom (see registration link below)
Abstract
The widespread popularity of ChatGPT has resulted in an increasing dependence on Large Language Models (LLM) among language learners for writing assistance, and in some instances, for generating text ostensibly as their own. In this talk, aimed at a non-technical audience, I explore various methods used to detect AI-generated writing, including machine learning and statistical approaches. Using an English learner corpus, I showcase two methods for identifying AI-generated writing: one focusing solely on function words, and another on content words. The corpus used in this study comprised 385 writers and 1407 essays, including 538 essays generated by GPT 3.5. We will consider: can these methods be trusted? Can students circumvent these techniques? To what extent should writing instructors be concerned about the use of AI? This talk will also delve into some interesting qualitative features that characterized AI-generated essays and practical suggestions for writing instructors concerned about the use of AI in the classroom.
Bio:
Dr. Peter Kim received his Ed.D. in Applied Linguistics from Teachers College, Columbia University and is currently the senior researcher at Cambridge Boxhill Language Assessment. His research interests include computer adaptive tests, cognitive diagnostic models, psychometrics, second language acquisition, language assessment and the application of AI in applied linguistics. Peter’s work has been published in journals such as Language Testing Research Quarterly, International Journal of Language Testing, Journal of Second Language Acquisition and Teaching, and NYS TESOL Journal.
To request disability-related accommodations, contact OASID at oasid@tc.edu, (212) 678-3689, as early as possible.