Optimasi Prediksi Kelulusan Tepat Waktu: Studi Perbandingan Algoritma Random Forest dan Algoritma K-NN Berbasis PSO

Authors

  • Indra Irawan Universitas Nurul Huda
  • M Riski Qisthiano Sistem Informasi, Institut Teknologi dan Bisnis Nasional (ITBN)
  • Muhammad Syahril 3Teknik Informatika, Politeknik Sekayu
  • Pamuji M. Jakak Universitas Nurul Huda

DOI:

https://doi.org/10.47747/jpsii.v4i4.1374

Keywords:

Random Forest, K-NN, PSO, Rapidminer, University, Students, Alumni

Abstract

The prediction of on-time graduation for students involves various measurement techniques, including criteria such as majors, class types, and semester grade achievements. These factors play a crucial role in determining whether students will complete their studies within the designated timeframe. In line with this, a model has been developed to forecast the probability of timely graduation. This model leverages the Random Forest and k-Nearest Neighbor (K-NN) algorithms as tools to classify students into appropriate groups. Optimization is carried out using the Particle Swarm Optimizer (PSO) algorithm to enhance prediction accuracy. The data used originates from alumni of various Universities in Palembang.This model utilizes multiple attributes, such as majors, university origins, class types, and semester grade records up to the fourth semester. Other attributes encompass the year of graduation and year of enrollment. Data management and processing are conducted using Rapidminer. Validation is performed by splitting the dataset into training and testing groups through the split validation method. Based on research and testing, the Random Forest algorithm achieves an accuracy of 95.79% with an Area Under Curve (AUC) of 0.991. After optimization with PSO, accuracy increases to 97.89% with an AUC of 0.993. Meanwhile, the k-NN algorithm achieves an accuracy of 93.49% with an AUC of 0.975; after optimization with PSO, accuracy rises to 96.74% with an AUC of 0.986.

 

References

A. Yandi Saputra and Y. Primadasa, “Penerapan Teknik Klasifikasi Untuk Prediksi Kelulusan Mahasiswa Menggunakan Algoritma K-Nearest Neighbour Implementation of Classification Method to Predict Student Graduation Using K-Nearest Neighbor Algorithm,” 2018.

“105-Article Text-142-1-10-20190125”.

A. Fauzi, A. Heri, and Y. #2, “JEPIN (Jurnal Edukasi dan Penelitian Informatika) Optimasi Algoritma Klasifikasi Naive Bayes, Decision Tree, K-Nearest Neighbor, dan Random Forest menggunakan Algoritma Particle Swarm Optimization pada Diabetes Dataset”.

P. Bidang Komputer Sains dan Pendidikan Informatika, D. Akademi Perekam dan Informasi Kesehatan Iris Padang Jl Gajah Mada No, and S. Barat, “Jurnal Edik Informatika Data Mining : Klasifikasi Menggunakan Algoritma C4.5 Yuli Mardi”.

Wikipedia contributors, “Particle swarm optimization. In Wikipedia, The Free Encyclopedia,” en.wikipedia.org, Aug. 10, 2023. https://en.wikipedia.org/w/index.php?title=Particle_swarm_optimization&oldid=1168805143 (accessed Sep. 20, 2023).

M. Husni Rifqo and N. David Veronica, “Implementasi Algoritme Naïve Bayes Berbasis Particle Swarm Optimization Dalam Penentuan Pemberian Kredit,” 2019. [Online]. Available: www.ejournal.unib.ac.id/index.php/pseudocode

G. S. Saragih and F. Ui, “Universitas Indonesia Prediksi Kebangkrutan Bank Dengan Menggunakan Random Forest Skripsi Glori Stephani Saragih 1406558153 Fakultas Matematika Dan Ilmu Pengetahuan Alam Program Studi Sarjana Matematika Depok Mei 2018.”

Wikipedia contributors, “K-nearest neighbors algorithm,” en.wikipedia.org, Aug. 10, 2023. https://en.wikipedia.org/w/index.php?title=Knearest_neighbors_algorithm&oldid=1168216736 (accessed Sep. 20, 2023).

Oon Wira Yuda, Darmawan Tuti, Lim Sheih Yee, and Susanti, “Penerapan Penerapan Data Mining Untuk Klasifikasi Kelulusan Mahasiswa Tepat Waktu Menggunakan Metode Random Forest,” SATIN - Sains dan Teknologi Informasi, vol. 8, no. 2, pp. 122–131, Dec. 2022, doi: 10.33372/stn.v8i2.885.

M. Labib Mu’tashim et al., “Klasifikasi Ketepatan Lama Studi Mahasiswa Dengan Algoritma Random Forest Dan Gradient Boosting (Studi Kasus Fakultas Ilmu Komputer Universitas Pembangunan Nasional Veteran Jakarta),” 2023.

T. Nasution, “Implementasi Algoritma K-Nearest Neighbor Untuk Penentuan Kelulusan Mahasiswa Tepat Waktu.”

Ramdani And Galih Farid, “Komparasi Metode K-Nearest Neighbor Dan Neural Network Untuk Menentukan Tingkat Akurasi Dalam Prediksi Kelulusan Mahasiswa (Studi Kasus: Program Studi Informatika Universitas Siliwangi) ,” Universitas Siliwangi, 2023. Accessed: Sep. 20, 2023. [Online]. Available: http://repositori.unsil.ac.id/10237/

Eko Prasetiyo Rohmawan, “Prediksi Kelulusan Mahasiswa Tepat Waktu Menggunakametode Desicion Tree Dan Artificial Neural Network,” Jurnal Ilmiah MATRIK, vol. 20, no. 1, 2018.

Downloads

Published

2023-10-01

How to Cite

Irawan, I., Qisthiano, M. R., Syahril, M., & Jakak, P. M. (2023). Optimasi Prediksi Kelulusan Tepat Waktu: Studi Perbandingan Algoritma Random Forest dan Algoritma K-NN Berbasis PSO. Jurnal Pengembangan Sistem Informasi Dan Informatika, 4(4), 26 - 35. https://doi.org/10.47747/jpsii.v4i4.1374