{"id":83861,"date":"2023-02-28T16:23:46","date_gmt":"2023-02-28T21:23:46","guid":{"rendered":"https:\/\/brocku.ca\/brock-news\/?p=83861"},"modified":"2024-09-01T09:54:35","modified_gmt":"2024-09-01T13:54:35","slug":"opinion-volante-deluca-and-klinger-discuss-how-chatgpt-may-lead-institutions-to-revisit-student-assessment","status":"publish","type":"post","link":"https:\/\/brocku.ca\/brock-news\/2023\/02\/opinion-volante-deluca-and-klinger-discuss-how-chatgpt-may-lead-institutions-to-revisit-student-assessment\/","title":{"rendered":"OPINION: Volante, DeLuca and Klinger discuss how ChatGPT may lead institutions to revisit student assessment"},"content":{"rendered":"

This article written by Louis Volante, Professor of Education at Brock University; Christopher DeLuca, Professor of Education at Queen\u2019s University; and Don A. Klinger, Professor of Measurement, Assessment and Evaluation at University of Waikato, was originally published in The Conversation<\/a><\/em>.<\/p>\n

Universities and schools have entered a new phase in how they need to address academic integrity as our society navigates a\u00a0second era of digital technologies, which include publicly available generative artificial intelligence (AI) like ChatGPT. Such platforms allow students to\u00a0generate novel text for written assignments.<\/p>\n

While many worry these advanced AI technologies are ushering in a\u00a0new age of plagiarism and cheating, these technologies also introduce opportunities for educators to rethink assessment practices and engage students in deeper and more meaningful learning that can promote critical thinking skills.<\/p>\n

We believe the emergence of ChatGPT creates an opportunity for schools and post-secondary institutions to reform traditional approaches to assessing students that rely heavily on testing and written tasks focused on students\u2019 recall, remembering and basic synthesis of content.<\/p>\n

Cheating and ChatGPT<\/h2>\n

Estimates of cheating\u00a0vary widely across national contexts and sectors.<\/p>\n

Sarah Elaine Eaton, an expert who studies academic integrity, cautions cheating\u00a0may be under-reported: she has estimated that at Canadian universities,\u00a070,000 students\u00a0buy cheating services every year.<\/p>\n

How the recent launch of ChatGPT by OpenAI will impact cheating in both compulsory and higher education settings is unknown, but how this evolves may depend on whether or not institutions retain or reform traditional assessment practices.<\/p>\n

Evading plagiarism detection software?<\/h2>\n

The ability of popular plagiarism detection tools to identify cheating using ChatGPT to generate assignments remains a challenge.<\/p>\n

A recent study, not yet peer reviewed, found that 50 essays generated using ChatGPT produced sophisticated texts that were able to evade the traditional plagiarism check software.<\/p>\n

Given that ChatGPT reached\u00a0an estimated 100 million monthly active users\u00a0in January, just two months after its launch, it is understandable why some have argued AI applications such as ChatGPT will spur\u00a0enormous changes\u00a0in contemporary schooling.<\/p>\n

Policy responses to AI and ChatGPT<\/h2>\n

Not surprisingly, there are opposing views on how to respond to ChatGPT and other AI language models.<\/p>\n

Some argue educators should embrace AI as a valuable technological tool, provided\u00a0applications are cited correctly.<\/p>\n

Others believe\u00a0more resources and training\u00a0are required so educators are better able to catch instances of cheating.<\/p>\n

Still others, such as New York City\u2019s Department of Education,\u00a0have resorted to blocking AI applications such as ChatGPT from devices and networks.<\/p>\n

Forward-thinking assessment<\/h2>\n

The figure below depicts three critical elements of a forward-thinking assessment system. Although each element could be elaborated, our focus is in offering educators a series of strategies that will allow them to maintain academic standards and promote authentic learning and assessment in the face of current and future AI applications.<\/p>\n

Teachers and university professors have relied heavily on \u201cone and done\u201d essay assignments for decades. Essentially, a student is assigned or asked to pick a generic essay topic from a list and submit their final assignment on a specific date.<\/p>\n

Such assignments are particularly susceptible to new AI applications, as well as\u00a0contract cheating<\/a>\u00a0\u2014 whereby a student buys a completed essay. Educators now need to rethink such assignments. Here are some strategies.<\/p>\n

    \n
  1. Consider ways to incorporate AI in valid assessment.<\/strong><\/li>\n<\/ol>\n

    It\u2019s not useful or practical for institutions to outright ban AI and applications like ChatGPT.<\/p>\n

    AI has already been incorporated into some\u00a0university classrooms. We believe AI technologies must be selectively integrated so that students are able to reflect on appropriate uses and connect their reflections to learning competencies.<\/p>\n

    For example, Paul Fyfe, an English professor\u00a0who teaches about how humans interact with data\u00a0describes a \u201cpedagogical experiment\u201d in which\u00a0he required students to take content from text-generating AI software and weave this content\u00a0into their final essay.<\/p>\n

    Students were then asked to confront the availability of AI as a writing tool and reflect on the ethical use and evaluation of language modes.<\/p>\n

      \n
    1. Engage students in setting learning goals.<\/strong><\/li>\n<\/ol>\n

      Ensuring students understand how they will be graded is key to any good assessment system.<\/p>\n

      Inviting students to collaboratively establish learning goals and criteria for the task, with consideration for the role of AI software, would help students to evaluate and judge appropriate contexts in which AI can work as a learning tool.<\/p>\n

        \n
      1. Require students to submit drafts for feedback.<\/strong><\/li>\n<\/ol>\n

        Although students should still complete essay assignments, research into academic integrity policy in response to generative AI suggests students should be required to\u00a0submit drafts of their work for review\u00a0and feedback. Apart from helping to detect plagiarism, this\u00a0kind of \u201cformative assessment\u201d practice is positive for guiding student learning.<\/p>\n

        Feedback can be offered by the teacher or by students themselves. Peer- and self-feedback can serve to critically evaluate work in progress (or work generated by AI software).<\/p>\n

          \n
        1. Grade subcomponents of the task.<\/strong><\/li>\n<\/ol>\n

          Students could receive a grade for each subcomponent \u2014 including their involvement in feedback processes. They would also be evaluated in relation to how well they incorporated and attended to the specific feedback provided.<\/p>\n

          The assignment becomes bigger than a final essay, it becomes a product of learning, where students\u2019 ideas are evaluated from development to final submission.<\/p>\n

            \n
          1. Move to more authentic assessments or include performance elements.<\/strong><\/li>\n<\/ol>\n

            Good assessment practice involves an educator observing student learning across multiple contexts.<\/p>\n

            For example, educators can invite students to present their work, discuss an essay in a conference format or share a video articulation or an artistic representation. The aim here is to encourage students to share their learning through an alternative format. An important question to ask is whether or not you need the essay component at all? Is there a more authentic way to effectively assess student learning?<\/p>\n

            Authentic assessments are those that relate content to context. When students are asked to do this, they must apply knowledge in more practical settings, often making AI tools less helpful.<\/p>\n

            For help in rethinking assessment practices towards more authentic and alternative approaches, educators can consider taking the free course,\u00a0Transforming Assessment: Strategies for Higher Education.<\/p>\n

            Improve benefits for students<\/h2>\n

            Collectively, these suggestions may be more time-consuming, particularly in larger undergraduate classes.<\/p>\n

            But they do provide greater learning and\u00a0synergy between forms of assessment\u00a0that benefit students: formative assessment to guide teaching and learning, and \u201csummative assessment,\u201d primarily used for grading and evaluation purposes.<\/p>\n

            AI is here and here to stay, and we must embrace it as part of our learning environment. Incorporating AI into how we assess student learning will yield more reliable assessment processes and valid and valued assessment outcomes.
            \n\"The<\/p>\n","protected":false},"excerpt":{"rendered":"

            Louis Volante, Professor of Education at Brock University; Christopher DeLuca, Professor of Education at Queen\u2019s University; and Don A. Klinger, Professor of Measurement, Assessment and Evaluation at University of Waikato, recently published a piece in The Conversation about ChatGPT and the need to reassess how students are graded.<\/p>\n","protected":false},"author":1,"featured_media":83873,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[40,7,6,1],"tags":[98,3028,5512],"_links":{"self":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts\/83861"}],"collection":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/comments?post=83861"}],"version-history":[{"count":7,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts\/83861\/revisions"}],"predecessor-version":[{"id":83881,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts\/83861\/revisions\/83881"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/media\/83873"}],"wp:attachment":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/media?parent=83861"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/categories?post=83861"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/tags?post=83861"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}