Online mathematics and statistics quizzes: impacts of generative AI on learning and assessment

As generative AI (artificial intelligence) technologies, such as ChatGPT, become increasingly available, traditional online assessments must be re-evaluated to maintain their educational value. Open-book online quizzes have long been an effective tool for engaging students, effectively supporting learning and reinforcing fundamental knowledge and skills. However, the ease of using AI to complete online quizzes may undermine their intended purpose.

This presentation will report the findings of using ChatGPT to answer twelve online quizzes used for continuous assessment in two first-year quantitative techniques modules on business programmes in an Irish technological university. The details will be presented, but the overall conclusion is that the mathematical and statistical questions in the online quizzes on these modules can be quickly completed with the assistance of ChatGPT to a high degree of success.

The implications of this for using online quizzes as an assessment strategy will be discussed, as well as the potential of generative AI to aid student comprehension and learning, and aspects of how to thoughtfully integrate generative AI into the learning and assessment process in an effective, equitable and ethical manner.