TY - GEN
T1 - Can Artificial Intelligence Complete My Assessment? A Student Led Initiative to Stress Test the Academic Integrity of University Assessment Using Generative AI
AU - Duane, Aidan
N1 - Publisher Copyright:
© 2024 International Conference on Higher Education Advances.
PY - 2024/6/18
Y1 - 2024/6/18
N2 - The ability of Generative AI (GenAI) to perform complex tasks has caused mixed feelings within the field of education. The most significant concern is the implications of GenAI for academic integrity. In this study, students applied GenAI to complete past university assessments adapted as research tests, with the goal of achieving a pass grade when graded by an academic, undetected by an AI writing detection tool. The study reveals that from a sample of 21 valid research tests, 23.8% (5) passed when graded by an academic achieving grades between 40% and 60%, with AI writing detection scores ranging between 0% and 14%. AI writing detection scores lower than 20% are potentially a false positive in the context of investigating breaches of academic integrity. The researcher concludes that many traditional methods of assessment in universities are obsolete in the face of increasingly undetectable AI generated solutions.
AB - The ability of Generative AI (GenAI) to perform complex tasks has caused mixed feelings within the field of education. The most significant concern is the implications of GenAI for academic integrity. In this study, students applied GenAI to complete past university assessments adapted as research tests, with the goal of achieving a pass grade when graded by an academic, undetected by an AI writing detection tool. The study reveals that from a sample of 21 valid research tests, 23.8% (5) passed when graded by an academic achieving grades between 40% and 60%, with AI writing detection scores ranging between 0% and 14%. AI writing detection scores lower than 20% are potentially a false positive in the context of investigating breaches of academic integrity. The researcher concludes that many traditional methods of assessment in universities are obsolete in the face of increasingly undetectable AI generated solutions.
KW - Academic Integrity
KW - Artificial Intelligence Writing Detection
KW - Assessment
KW - GenAI
KW - Generative Artificial Intelligence
UR - http://www.scopus.com/inward/record.url?scp=85200739401&partnerID=8YFLogxK
U2 - 10.4995/head24.2024.17143
DO - 10.4995/head24.2024.17143
M3 - Conference contribution
AN - SCOPUS:85200739401
T3 - 10th International Conference on Higher Education Advances (HEAd’24)
SP - 10
EP - 17
BT - HEAd 2024 - 10th International Conference on Higher Education Advances
PB - Universidad Politecnica de Valencia.
T2 - 10th International Conference on Higher Education Advances, HEAd 2024
Y2 - 18 June 2024 through 21 June 2024
ER -