Can Artificial Intelligence Complete My Assessment? A Student Led Initiative to Stress Test the Academic Integrity of University Assessment Using Generative AI

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The ability of Generative AI (GenAI) to perform complex tasks has caused mixed feelings within the field of education. The most significant concern is the implications of GenAI for academic integrity. In this study, students applied GenAI to complete past university assessments adapted as research tests, with the goal of achieving a pass grade when graded by an academic, undetected by an AI writing detection tool. The study reveals that from a sample of 21 valid research tests, 23.8% (5) passed when graded by an academic achieving grades between 40% and 60%, with AI writing detection scores ranging between 0% and 14%. AI writing detection scores lower than 20% are potentially a false positive in the context of investigating breaches of academic integrity. The researcher concludes that many traditional methods of assessment in universities are obsolete in the face of increasingly undetectable AI generated solutions.

Original languageEnglish
Title of host publicationHEAd 2024 - 10th International Conference on Higher Education Advances
PublisherUniversidad Politecnica de Valencia.
Pages10-17
Number of pages8
ISBN (Electronic)9788413962009
DOIs
Publication statusPublished - 18 Jun 2024
Event10th International Conference on Higher Education Advances, HEAd 2024 - Valencia, Spain
Duration: 18 Jun 202421 Jun 2024

Publication series

Name10th International Conference on Higher Education Advances (HEAd’24)

Conference

Conference10th International Conference on Higher Education Advances, HEAd 2024
Country/TerritorySpain
CityValencia
Period18/06/202421/06/2024

Keywords

  • Academic Integrity
  • Artificial Intelligence Writing Detection
  • Assessment
  • GenAI
  • Generative Artificial Intelligence

Fingerprint

Dive into the research topics of 'Can Artificial Intelligence Complete My Assessment? A Student Led Initiative to Stress Test the Academic Integrity of University Assessment Using Generative AI'. Together they form a unique fingerprint.

Cite this