Process mining based approach to performance evaluation in computer-aided examinations


BAYKASOĞLU A., Ozbel B. K., DUDAKLI N., SUBULAN K., Senol M. E.

COMPUTER APPLICATIONS IN ENGINEERING EDUCATION, cilt.26, sa.5, ss.1841-1861, 2018 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 26 Sayı: 5
  • Basım Tarihi: 2018
  • Doi Numarası: 10.1002/cae.21971
  • Dergi Adı: COMPUTER APPLICATIONS IN ENGINEERING EDUCATION
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.1841-1861
  • Anahtar Kelimeler: computer-aided exam evaluation, enterprise resource planning, process mining, similarity measures, student performance evaluation, system event logs, AUTOMATED ASSESSMENT, SIMILARITY
  • Dokuz Eylül Üniversitesi Adresli: Evet

Özet

A considerable part of educational systems tends to be online and computer oriented. However, online examination may create some difficulties during the evaluation of student performance. Process mining which arises as a new concept presents various powerful techniques for processing and analyzing different types of data by making use of some advanced information technologies. This paper proposes a novel approach based on process mining for evaluating the performance of students that should follow certain tasks on the computer. The proposed approach is composed of two main phases which are process mining and similarity analysis. Automatic assessment is performed totally in six steps in order to obtain students' final grades. In addition, cheat control is possible in the last step thanks to the similarity analysis. A real-life application in an Enterprise Resource Planning (ERP) course is performed in order to present usefulness, validity and practicality of the proposed approach. Furthermore, to evaluate the performance of the assessment system, we compared the assessment mechanism against instructor. A total of 15 students' answers belonging to computer-aided exam are assessed by instructor and the results showed a very good agreement between the automatic assessment system and instructor.