Polytechnic and design, Vol. 11 No. 4, 2023.
Professional paper
https://doi.org/10.19279/TVZ.PD.2023-11-4-05
USING CHATGPT TO SOLVE INTRODUCTION TO PROGRAMMING EXAM
Goran Đambić
orcid.org/0000-0001-5790-7701
; Algebra University College, Gradišćanska 24, 10000 Zagreb, Croatia
Abstract
ChatGPT and other artificial intelligence models have entered many aspects of life, including higher education. In addition to providing learning opportunities, artificial intelligence models offer students the chance to cheat on tests, posing new challenges for teachers. The capabilities of ChatGPT to generate program code based on English input text are well-explored. However, there are no papers addressing the behavior of the model when tasked with writing programming assignments in Croatian. Therefore, the aim of this paper is to investigate more thoroughly the current performance of the ChatGPT 3.5 model in that area. The paper consists of three main parts. In the first part, exam tasks from the Introduction to Programming course are presented to the ChatGPT in the same format as they were given to students. In the second part, an analysis is conducted to assess how detectable it is that the solutions were created through automatic generation rather than by the student. Finally, the inputs to ChatGPT are modified, and an investigation is carried out to determine whether it is possible to influence the shape of the generated solutions so that they do not differ from student solutions.
Keywords
AI generated program code; ChatGPT inputs in Croatian; course Introduction to programming; AI in higher education; disruption of education caused by artificial intelligence
Hrčak ID:
318106
URI
Publication date:
5.2.2024.
Visits: 543 *