ChatGPT: A Department-Level Analysis of Usage Possibilities and Actualities
Abstract
In the past few months generative AI and large language models, e.g. ChatGPT, have rapidly become a target of scorn, derision, and fear amongst many faculty in higher education. The Department of Chemistry has undertaken a study to investigate current and potential future impact of this technology for students with a focus on the most common writing-intensive aspect of our curriculum: lab reports. AI-generated reports for lab exercises spanning the curriculum have been generated for analysis and compared to faculty expectations of student submissions. Assessment results for ChatGPT-generated lab reports with several tiers of sophistication in their prompts were evaluated by tenured faculty. These results will be shared. Preliminary survey results of students' knowledge and use of ChatGPT will also be shared.
College
College of Science & Engineering
Department
Chemistry
Start Date
4-19-2023 12:40 PM
End Date
4-19-2023 1:00 PM
Presentation Type
Oral Presentation
Format of Presentation or Performance
In-Person
ChatGPT: A Department-Level Analysis of Usage Possibilities and Actualities
In the past few months generative AI and large language models, e.g. ChatGPT, have rapidly become a target of scorn, derision, and fear amongst many faculty in higher education. The Department of Chemistry has undertaken a study to investigate current and potential future impact of this technology for students with a focus on the most common writing-intensive aspect of our curriculum: lab reports. AI-generated reports for lab exercises spanning the curriculum have been generated for analysis and compared to faculty expectations of student submissions. Assessment results for ChatGPT-generated lab reports with several tiers of sophistication in their prompts were evaluated by tenured faculty. These results will be shared. Preliminary survey results of students' knowledge and use of ChatGPT will also be shared.
