GRID SEARCH AND RANDOM SEARCH HYPERPARAMETER TUNING OPTIMIZATION IN XGBOOST ALGORITHM FOR PARKINSON’S DISEASE CLASSIFICATION
Abstract
Parkinson's disease is a neurodegenerative disorder affecting motor abilities, with a prevalence of 329 cases per 100,000 individuals. Early diagnosis is crucial to prevent complications. This study classifies Parkinson's disease using the Extreme Gradient Boosting (XGBoost) algorithm with hyperparameter tuning via Grid Search and Random Search. The dataset from Kaggle consists of 2105 records from 2024 and includes 32 clinical and demographic features such as age, gender, BMI, medical history, and Parkinson's symptoms. The XGBoost method effectively manages large and complex data and reduces. Tuning was performed with 5-fold cross-validation for result validity. After tuning with Grid Search, the model achieved 93.35% accuracy in 44 minutes 51 seconds, with optimal parameters gamma=5, max depth=3, learning rate=0.3, n estimators=100, and subsample=0.7. Meanwhile, Random Search with 50 iterations achieved 93.97% accuracy in 3 minutes 4 seconds with optimal parameters gamma=5, max depth=3, learning rate=0.262, n estimators=58, and subsample=0.631. Random Search also shows better time efficiency than Grid Search, although with relatively similar accuracy. The results of this study confirm that hyperparameter tuning using Random Search not only produces competitive accuracy performance but also minimizes computation time, making it a more optimal choice for Parkinson's disease classification.
Downloads
References
S. A. Tanazza and L. M. Erawati, “ANALISIS INTERVENSI FISIOTERAPI PADA PENYAKIT PARKINSON MENGGUNAKAN VOSVIEWER,” Physio J., vol. 2, no. 2, pp. 49–60, 2022, https://doi.org/10.30787/phyjou.v2i2.877.
P. Tristiawati, KENALI PENYEBAB, GEJALA, DAN PENGOBATAN PENYAKIT PARKINSON YANG PENDERITANYA CAPAI 400 RIBU DI INDONESIA, vol. Liputan6. 2024, p. [Online]. Available: https://www.liputan6.com/health/read/5580264/kenali-penyebab-gejala-dan-pengobatan-penyakit-parkinson-yang-penderitanya-capai-400-ribu-di-indonesia
I. S. Zein and Khairunnisa., “PARKINSON DISEASE,” American family physician, vol. 102, no. 11, pp. 679–691, 2023. https://doi.org/10.55606/jurrike.v2i2.1701.
A. Lees et al., “OPTIMIZING LEVODOPA THERAPY, WHEN AND HOW? PERSPECTIVES ON THE IMPORTANCE OF DELIVERY AND THE POTENTIAL FOR AN EARLY COMBINATION APPROACH,” Expert Rev. Neurother., vol. 23, no. 1, pp. 15–24, 2023, https://doi.org/10.1080/14737175.2023.2176220.
M. J. Armstrong and M. S. Okun, “DIAGNOSIS AND TREATMENT OF PARKINSON DISEASE: A REVIEW,” JAMA - J. Am. Med. Assoc., vol. 323, no. 6, pp. 548–560, 2020, https://doi.org/10.1001/jama.2019.22360.
F. N. A. N. Hati, MENELUSURI LABIRIN PARKINSON: DEFINISI, GEJALA, DAN TANTANGAN MASA KINI, vol. RSA UGM. 2024, p. [Online]. Available: https://rsa.ugm.ac.id/2024/06/menelusuri-labirin-parkinson-definisi-gejala-dan-tantangan-masa-kini/
J. Jankovic and E. K. Tan, “PARKINSON’S DISEASE: ETIOPATHOGENESIS AND TREATMENT,” J. Neurol. Neurosurg. Psychiatry, vol. 91, no. 8, pp. 795–808, 2020, https://doi.org/10.1136/jnnp-2019-322338.
F. F. Sutantoyo, P. Nugraha, and M. Hamdan, “GAMBARAN PASIEN PARKINSONISME VASKULAR: SEBUAH LAPORAN KASUS,” J. Aksona, vol. 1, no. 5, pp. 140–145, 2020.
M. I. Sodikin, “PENERAPAN DAN MANFAAT MACHINE LEARNING DI RUMAH SAKIT,” Multiverse Open Multidiscip. J., vol. 2, no. 2, pp. 262–265, 2023, https://doi.org/10.57251/multiverse.v2i2.1207.
F. Nurrahman, H. Wijayanto, A. H. Wigena, and N. Nurjanah, “PRE-PROCESSING DATA ON MULTICLASS CLASSIFICATION OF ANEMIA AND IRON DEFICIENCY WITH THE XGBOOST METHOD,” BAREKENG J. Ilmu Mat. dan Terap., vol. 17, no. 2, pp. 0767–0774, 2023, https://doi.org/10.30598/barekengvol17iss2pp0767-0774.
Muhamad Fikri, “KLASIFIKASI STATUS STUNTING PADA ANAK BAWAH LIMA TAHUN MENGGUNAKAN EXTREME GRADIENT BOOSTING,” Merkurius J. Ris. Sist. Inf. dan Tek. Inform., vol. 2, no. 4, pp. 173–184, 2024, https://doi.org/10.61132/merkurius.v2i4.159.
R. Harahap et al., “PERBANDINGAN KINERJA ALGORITMA RANDOM FOREST DAN XGBOOST DALAM KLASIFIKASI PENYAKIT PARU-PARU BERDASARKAN DATA DEMOGRAFI PASIEN,” no. 02, pp. 130–141.
Y. Amelia, “PERBANDINGAN METODE MACHINE LEARNING UNTUK MENDETEKSI PENYAKIT JANTUNG,” IDEALIS Indones. J. Inf. Syst., vol. 6, no. 2, pp. 220–225, 2023, https://doi.org/10.36080/idealis.v6i2.3043.
G. Abdurrahman, H. Oktavianto, and M. Sintawati, “OPTIMASI ALGORITMA XGBOOST CLASSIFIER MENGGUNAKAN HYPERPARAMETER GRIDESEARCH DAN RANDOM SEARCH PADA KLASIFIKASI PENYAKIT DIABETES,” INFORMAL Informatics J., vol. 7, no. 3, p. 193, 2022, https://doi.org/10.19184/isj.v7i3.35441.
R. J. Alfirdausy, N. Ulinnuha, and W. D. Utami, “IMPLEMENTATION OF THE EXTREME GRADIENT BOOSTING ALGORITHM WITH HYPERPARAMETER TUNING IN CELIAC DISEASE CLASSIFICATION,” vol. 24, no. 1, pp. 117–128, 2024, https://doi.org/10.30812/matrik.v24i1.4031.
D. Kurnia, M. Itqan Mazdadi, D. Kartini, R. Adi Nugroho, and F. Abadi, “SELEKSI FITUR DENGAN PARTICLE SWARM OPTIMIZATION PADA KLASIFIKASI PENYAKIT PARKINSON MENGGUNAKAN XGBOOST,” J. Teknol. Inf. dan Ilmu Komput., vol. 10, no. 5, pp. 1083–1094, 2023, https://doi.org/10.25126/jtiik.20231057252.
M. D. Mubarak, A. Afdal, D. Pertiwi, N. R. Masnadi, Z. D. Rofinda, and T. Handayani, “GAMBARAN GEJALA DEPRESI PADA PENDERITA PARKINSON DISEASE DI RSI IBNU SINA PADANG,” J. Ilmu Kesehat. Indones., vol. 5, no. 2, pp. 170–177, 2024, https://doi.org/10.25077/jikesi.v5i2.1153.
A. Desiani, I. Ramayanti, M. Arhami, P. Studi Matematika, and F. Matematika dan Ilmu Pengetahuan Alam, “DIAGNOSIS OF PARKINSON’S DISEASE USING K-NEAREST NEIGHBOR AND DECISION TREE C4.5 ALGORITHMS,” vol. 12, no. 1, pp. 47–58, 2023,https://doi.org/10.21107/simantec.v12i1.21167.
R. el Kharoua, PARKINSON’S DISEASE DATASET ANALYSIS. 2024. [Online]. Available: https://www.kaggle.com/datasets/rabieelkharoua/parkinsons-disease-dataset-analysis?select=parkinsons_disease_data.csv
S. Amelia, “PENERAPAN METODE MODIFIED K-NEAREST NEIGHBOR PADA PENGKLASIFIKASIAN STATUS PEMBAYARAN KREDIT BARANG ELEKTRONIK DAN FURNITURE,” Stat. J. Theor. Stat. Its Appl., vol. 22, no. 1, pp. 95–104, 2022, https://doi.org/10.29313/statistika.v22i1.345.
Heliyanti Susana, “PENERAPAN MODEL KLASIFIKASI METODE NAIVE BAYES TERHADAP PENGGUNAAN AKSES INTERNET,” J. Ris. Sist. Inf. dan Teknol. Inf., vol. 4, no. 1, pp. 1–8, 2022, https://doi.org/10.52005/jursistekni.v4i1.96.
H. F. Putro, R. T. Vulandari, and W. L. Y. Saptomo, “PENERAPAN METODE NAIVE BAYES UNTUK KLASIFIKASI PELANGGAN,” J. Teknol. Inf. dan Komun., vol. 8, no. 2, 2020, https://doi.org/10.30646/tikomsin.v8i2.500.
S. E. Herni Yulianti, Oni Soesanto, and Yuana Sukmawaty, “PENERAPAN METODE EXTREME GRADIENT BOOSTING (XGBOOST) PADA KLASIFIKASI NASABAH KARTU KREDIT,” J. Math. Theory Appl., vol. 4, no. 1, pp. 21–26, 2022, https://doi.org/10.31605/jomta.v4i1.1792.
A. Shahraki, M. Abbasi, and Ø. Haugen, “BOOSTING ALGORITHMS FOR NETWORK INTRUSION DETECTION: A COMPARATIVE EVALUATION OF REAL ADABOOST, GENTLE ADABOOST AND MODEST ADABOOST,” Eng. Appl. Artif. Intell., vol. 94, no. February, p. 103770, 2020, https://doi.org/10.1016/j.engappai.2020.103770.
C. Wang, C. Deng, and S. Wang, “IMBALANCE-XGBOOST: LEVERAGING WEIGHTED AND FOCAL LOSSES FOR BINARY LABEL-IMBALANCED CLASSIFICATION WITH XGBOOST,” Pattern Recognit. Lett., vol. 136, pp. 190–197, 2020, https://doi.org/10.1016/j.patrec.2020.05.035.
A. F. A. Naibaho and A. Zahra, “PREDIKSI KELULUSAN SISWA SEKOLAH MENENGAH PERTAMA MENGGUNAKAN MACHINE LEARNING,” J. Inform. dan Tek. Elektro Terap., vol. 11, no. 3, pp. 173–183, 2023, https://doi.org/10.23960/jitet.v11i3.3056.
M. W. Dwinanda, N. Satyahadewi, and W. Andani, “CLASSIFICATION OF STUDENT GRADUATION STATUS USING XGBOOST ALGORITHM,” BAREKENG J. Ilmu Mat. dan Terap., vol. 17, no. 3, pp. 1785–1794, 2023, https://doi.org/10.30598/barekengvol17iss3pp1785-1794.
W. Nugraha and A. Sasongko, “HYPERPARAMETER TUNING PADA ALGORITMA KLASIFIKASI DENGAN GRID SEARCH HYPERPARAMETER TUNING ON CLASSIFICATION ALGORITHM WITH GRID SEARCH,” Sist. J. Sist. Inf., vol. 11, no. 2, pp. 391–401, 2022, [Online]. Available: http://sistemasi.ftik.unisi.ac.id
U. Sunarya and T. Haryanti, “PERBANDINGAN KINERJA ALGORITMA OPTIMASI PADA METODE RANDOM FOREST UNTUK DETEKSI KEGAGALAN JANTUNG,” J. Rekayasa Elektr., vol. 18, no. 4, pp. 241–247, 2022, https://doi.org/10.17529/jre.v18i4.26981.
M. A. Abubakar, M. Muliadi, A. Farmadi, R. Herteno, and R. Ramadhani, “RANDOM FOREST DENGAN RANDOM SEARCH TERHADAP KETIDAKSEIMBANGAN KELAS PADA PREDIKSI GAGAL JANTUNG,” J. Inform., vol. 10, no. 1, pp. 13–18, 2023, https://doi.org/10.31294/inf.v10i1.14531.
D. Normawati and S. A. Prayogi, “IMPLEMENTASI NAÏVE BAYES CLASSIFIER DAN CONFUSION MATRIX PADA ANALISIS SENTIMEN BERBASIS TEKS PADA TWITTER,” J. Sains Komput. Inform., vol. 5, no. 2, pp. 697–711, 2021, https://doi.org/http://dx.doi.org/10.30645/j-sakti.v5i2.369.
R. S. Amardita, A. Adiwijaya, and M. D. Purbolaksono, “ANALISIS SENTIMEN TERHADAP ULASAN PARIS VAN JAVA RESORT LIFESTYLE PLACE DI KOTA BANDUNG MENGGUNAKAN ALGORITMA KNN,” JURIKOM (Jurnal Ris. Komputer), vol. 9, no. 1, p. 62, 2022, https://doi.org/10.30865/jurikom.v9i1.3793.
Yurivo Rianda Saputra, Syafriandi Syafriandi, Dony Permana, and Zilrahmi, “CLASSIFICATION OF PROGRAM KELUARGA HARAPAN RECIPIENT HOUSEHOLDS IN PADANG USING K-NEAREST NEIGHBORS,” UNP J. Stat. Data Sci., vol. 2, no. 2, pp. 187–195, 2024, https://doi.org/10.24036/ujsds/vol2-iss2/167.
Copyright (c) 2025 Shafa Fitria Aqilah Khansa, Nurissaidah Ulinnuha, Wika Dianita Utami
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this Journal agree to the following terms:
- Author retain copyright and grant the journal right of first publication with the work simultaneously licensed under a creative commons attribution license that allow others to share the work within an acknowledgement of the work’s authorship and initial publication of this journal.
- Authors are able to enter into separate, additional contractual arrangement for the non-exclusive distribution of the journal’s published version of the work (e.g. acknowledgement of its initial publication in this journal).
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their websites) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published works.
1.gif)
