ANALYZING GAME PLAY DATA FOR ACADEMIC PERFORMANCE IMPROVEMENT: A DECISION FOREST APPROACH

Fahmi Izhari, Sutarman Sutarman

Abstract


This study emphasizes the importance of comprehending the correlation between level_groups and questions prior to beginning the data training process. After completing stages 0 to 4, the game introduces a preliminary assessment checkpoint consisting of questions 1 to 3. The selection of training data entails matching data from specific level_groups to pertinent questions, thereby ensuring a tailored approach to model construction. Individual models were painstakingly developed for each query, and their accuracy was assessed; the average accuracy was 0.75585266561448. Due to the irregular distribution of 'correct' column values, the default 0.5 threshold for predicting classes may not optimize performance. To mitigate this, the F1 score, which is superior in evaluating imbalanced scenarios, was computed across multiple thresholds to identify the optimal threshold yielding the highest F1 score, about 0.63. This optimal threshold establishing a balance between precision and recall is crucial for accurate mapping of predicted probabilities to class labels 0 or 1. To effectively advance the discipline, future research should prioritize a clear research roadmap, the incorporation of emerging technologies, collaboration, and data quality.

Keywords: Game-based Learning, Model Accuracy, F1 Score.


Full Text:

PDF

References


Bai S, Hew K, Huang B. Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts.2020 doi: 10.1016/j.edurev.2020.100322.

Christopher Franzwa, Ying Tang, Aaron Johnson, and Talbot Bielefeldt. Balancing fun and learning in a serious game design. Gamification, page 452–471, 2015. doi: 10.4018/978-1-4666-8200-9.ch022.

David Gagnon, Maggie, Meg Benner, Perpetual Baffour, Phil Culliton, Scott Crossley, ulrichboser. (2023). Predict Student Performance from Game Play. Kaggle.

Robert Sottilare, Arthur Graesser, Xiangen Hu, and Keith Brawner. Design Recommendations for Intelligent Tutoring Systems - Volume 3: Authoring Tools and Expert Modeling Techniques. 06 2015. ISBN 978-0-9893923-7-2.

Sadique Ahmad, Mohammed A. El-Affendi, M. Shahid Anwar, Rizwan Iqbal. Potential Future Directions in Optimization of Students’ Performance Prediction System. Computational Intelligence and Neuroscience, vol. 2022, Article ID 6864955, 26 pages, 2022. doi: 10.1155/2022/6864955.

Valerie J. Shute, Lubin Wang, Samuel Greiff, Weinan Zhao, and Gregory Moore. Measuring problem-solving skills via stealth assessment in an engaging video game. Computers in Human Behavior, 63:106–117, 2016. doi: 10.1016/j.chb.2016.05.047.

V.j. Shute and S. Rahimi. Review of computer-based assessment for learning in elementary and secondary education. Journal of Computer Assisted Learning, 33(1):1–19, 2017. doi: 10.1111/jcal.12172.

Ying Tang, Kauser Jahan, and Talbot Bielefeldt. The effectiveness of an adaptive serious game for digital logic design. 2015 ASEE Annual Conference and Exposition Proceedings, 2015. doi: 10.18260/p.24861.

YingTang,ChristopherFranzwa,TalbotBielefeldt,KauserJahan,MarziehS.Saeedi-Hosseiny,NathanLamb, and Shengtao Sun. Sustain city. Design, Motivation, and Frameworks in Game-Based Learning Advances in Game-Based Learning, page 57–91, 2017. doi: 10.4018/978-1-5225-6026-5.ch003.


Article Metrics

Abstract view : 41 times
PDF – 24 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 PROSIDING UNIVERSITAS DHARMAWANGSA

Prosiding Universitas Dharmawangsa Terindex pada:

PROSIDING SEMINAR NASIONAL DAN INTERNASIONAL PUBLISHED BY :

UPT. Penerbitan dan Publikasi Ilmiah
UNIVERSITAS DHARMAWANGSA

Alamat : Jl. K. L. Yos Sudarso No. 224 Medan
Kontak : Tel. 061 6635682 - 6613783  Fax. 061 6615190
Surat Elektronik : ppi@dharmawangsa.ac.id

 

 Creative Commons License

Prosiding Seminar Nasional dan Internasional By Universitas Dharmawangsa is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at
 https://proceeding.dharmawangsa.ac.id/index.php/PSND/index