APPLICATION OF PERFORMANCE ASSESSMENT WITH METHOD DIFFICULTY LEVEL, DISTINGUISHING POWER, DISTRACTOR EFFECTIVENESS, AND ANOVA (Case Study: Paper Based Test (PBT) Period 2 Questions 2020–2021 Islamic University of Indonesia)
Abstract
The quality of human resources can be improved through education. The Islamic University of Indonesia provides various selection patterns for prospective new students, one of which is PBT. Questions in PBT need to be analyzed to get quality students. The length of time to analyze the performance of questions that include the level of difficulty, distinguishing power, and distractor effectiveness in PBT Period 2 2020-2021 UII is one of the reasons for making computer programs using Microsoft Excel 2013. The methods used are simple random sampling and One-Way ANOVA analysis. The results of this study can make it easier to process data and analyze the performance of the questions with the help of the OASIS application which can be used as material for future evaluation. Analysis of the performance of the questions is classified as very difficult and difficult at the level of difficulty, the category is bad on the distinguishing power, and the effectiveness of the distractor is functioning properly, and there is one of the scores obtained by the test takers from three types of questions with the choice of the Faculty of Medicine and not choosing the Faculty of Medicine of UII which has the average is different from the others.
Downloads
References
A. H. Primandari, “Multiple Comparison Test” [PowerPoint slides], 2018, [Online]. Available: https://arumprimandari.files.wordpress.com/2018/10/course-5_uji-perbandingan-ganda.pdf, [Accessed 12 December 2020].
A. L. F. Tilaar, V. Sulangi dan A. Madalise, “Analysis of the Quality of Test Items Made by a Class X Mathematics Teacher at SMA Negeri 1 Airmadidi Knows the Teachings of 2019/2020”. JSME (Journal of Science, Mathematics & Education), vol. 8, no. 2, pp. 190–196, 2020.
A. P. Utomo dan M. P. Damayanti, “Design of a Dashboard for an Information System for Monitoring and Evaluation of High School Student Achievement Based on the 2013 Curriculum”. E-BISNIS, vol. 9, no. 1, pp. 24-31, 2016.
A. Sudijono, Introduction to Educational Evaluation. Jakarta: Raja Grafindo Persada, 2006, 411.
A. Wibowo, Improvement of Autocorrelation Assumptions Using the Cochrane-Orcutt Method (Study of Is Oil and Gas A Blessing Or Disaster”. JMPM: Journal of Mathematics and Mathematics Education, vol. 5, no. 1, pp. 23-30, 2020.
A. Z. Izza, M. Falah, dan Susilawati, “Literature Studies: Problems of Learning Evaluation in Achieving Educational Goals in the Era of Free Learning”. Scientific Conference on Education, vol. 1, no. 1, pp. 10-15, 2020.
Budiyono, Statistics for Research. Surakarta: Sebelas Maret University, 2004, 214-215.
B. F. Nugraha, “Forecasting Indonesian Inflation Based on CPI on Exports, Imports and Bi Rates,” Doctoral dissertation, Institut Teknolohi Sepuluh November, 2018.
C. Zaiontz, “Real Statistics Using Excel Welch's ANOVA Test”, 2015, [Online]. Available: https://www.real-statistics.com/one-way-analysis-of-variance-anova/welchs-procedure/ [Accessed 9 November 2020].
D. C. Montgomery, Design and Analysis of Experiments (8^thed.). Arizona: Arizona State University, 2013.
D. Rahmasari dan Ismiyati, “Analysis of Items in Introduction to Office Administration”. Economic Education Analysis Journal, vol. 5, no. 1, pp. 317–330, 2016.
D. Setiadi, Febriansyah, T. Susanti, “Socialization and Workshop on Application of Processing Values for Middle School/MTS Exams in Pagar Alam City by Using Microsoft Excel 2016”. NGABDIMAS, vol. 04, no. 01, 2021
E. Dwimawati, F. Beliansyah, dan S. A. Zulfa, “Community Empowerment through Utilization of Technology in Order to Improve the Quality of Human Resources in Gunung Menyan Village”. Abdi Dosen: Journal of Community Service, vol. 3, no. 1, 2019.
Haderani, “Philosophical Overview of the Function of Education in Human Life”. Jurnal Tarbiyah:Scientific Journal of Education, vol. 7, no. 1, pp. 41–49, 2018.
Harmastuti dan D. Setyowati, “Utilization of Microsoft Excel for Learning Mathematics and Graphs”. Dharma Bakti Journal, vol. 1, no. 1, pp 57–66, 2018.
H. D. Lestari dan D. P. Parmiti, “Development of Science E-Modules with Online Tests to Improve Learning Outcomes”. Journal of Education Technology, vol. 4, no. 1, pp. 73-79, 2020.
J. Harlan, Analysis of Varians(1^sted.). Depok: Gunadarma, 2018.
J. L. Marpaung, A. Sutrisno, dan R. Lumintang, “Application of ANOVA Method for Analysis of Mechanical Properties of Coconut Fiber Composites”. Online Journal of Mechanical Engineering Axis, vol. 6, no. 2, pp 151–162, 2016.
J. R. Lazante, “Testing for Differences Between Two Distributions in the Presence of Serial Correlation Using the Kolmogorv-Smirnov and Kuiper’s Tests”. International Journal of Climatology, Vol. 41, no. 14, pp. 6314-6323, 2021.
L. Herawati, Health Data Normality Test Using SPSS (1^sted.). Yogyakarta: Poltekkes Jogja Press, 2016.
L. Nurdin, Sugiman, dan Sunarmi, “Application of the Combination of Ridge Regression (RR) Method and Generalized Least Square (GLS) Method to Overcome Multicollinearity and Autocorrelation Problems”. Mipa Journal, vol. 41, no. 1, pp. 58–68, 2018.
M. B. Brown dan A. B. Forsythe, “Robust Test for The Equality of Variances”. Journal of The American Statistical Association, vol. 69, pp. 364-367, 1974.
M. Ilyas, “Analysis of the Final Examination Questions for the Arabic Language Semester of MTs Class VII Output from the Ministry of Religion Banyumas at MTs MWI Kebarongan, Kemranjen, Banyumas for the 2017/2018 Academic Year,” Doctoral dissertation, IAIN, 2018.
M. Puspitarini, “Measuring the Effectiveness of Questions with AnBuso”, 2012, [Online]. Available: https://news.okezone.com/read/2012/08/07/373/674542/ukur-tingkat-efektivitas-soal-dengan-anbso [Accessed 7 September 2020].
M. Z. Ashfiya, “Comparison of Engagement Rates between Instagram Photo and Video Posts,” Thesis. Yogyakarta State University, 2018.
N. Agustin, “Analysis of Odd Semester Final Examination Questions for Islamic Religious Education Subjects From the Level of Difficulty and Distinguishing Power in Class VIII IN Bina Insani Metro Integrated Islamic Junior High School,” Thesis. State Islamic Institute (IAIN), 2019.
N. C. Karissanata, “Analysis of the Effect of the January Effect and Moday Effect on the Return of Companies Listed as LQ-45 Index on the Indonesia Stock Exchange for the 2015–2018 Period,” Thesis. Islamic University of Indonesian, 2019.
N. K. Erawati, “Analysis of Competency Achievement Assessment Tests for Midwifery Students”. Penjakora Journal, vol. 5, no. 2, pp. 111-120, 2019.
Nurma, “Analysis of Variance (ANOVA)” [PowerPoint slides], 2013, [Online]. Available:
https://nurma.staff.uns.ac.id/wp-content/blogs.dir/224/files/2013/03/Chap_1_ANAVA1-2012_1-2013.pdf [Accessed: 7 September 2020].
Nurmawati, Evaluation of Islamic Education. Bandung: Cipta Pustaka Media, 2016, 44-45.
N. Rumbia, “Analysis of the Quality of Even Semester Exam Questions in the PAI Study Sector class XI at the Islamic High School Integrated Wadah Islaminya Makasar for the 2016/2017 Academic Year,” Thesis. Alauddin State Islamic University Makassar, 2018.
Government of Indonesia, Law no. 20 of 2003 which regulates the National Education System. State Gazette of the Republic of Indonesia Year 2003, No. 4301. Secretariat of State Jakarta, 2003.
PMB UII, “History and Development”, 2020, [Online]. Available:
https://pmb.uii.ac.id/tentang-universitas-islam-indonesia/ [Accessed: 7 September 2020].
R. Moeriyandani dan B. Yulianto, “Analysis of Dokkai Test Items for Class XI Students Specializing in Japanese at SMA Negeri Sumenep". Journal of Education and Development, vol. 9, no. 3, pp. 461-466, 2021.
R. T. Jurnal, “Quantitative Method with Classical Approach in Application of Item Analysis as Evaluation Media for Quality Question Determination”. Kilat, vol. 7, no. 1, pp. 15-23, 2018.
S. Arikunto, Fundamentals of Educational Evaluation. Jakarta: Bumi Aksara, 2012, 223-234.
S. H. Pambayu, “Analysis of the Quality of Test Items at the End of Odd Semester Final Test for Physical Education Subject Class VII SMP Negeri 1 Jati District, Kudus Regency, 2018/2019 Academic Year," Thesis. Yogyakarta State University, 2019.
Suratini, “The Influence of Education in Improving the Quality of Human Resources in Indonesia”. Journal of Management and Accounting, vol. 5, no. 1, pp. 68–84, 2017.
UNY, “Staff Site Yogyakarta State University”, 2022, [Online]. Available: http://staffnew.uny.ac.id/staff/132232818 [Accessed 25 Maret 2022].
Wulan, “Analysis of Multiple Choice Questions for the Final Assessment of Odd Semester Subjects for Physical Education, Sport and Health Class V at SD Negeri Jetis, Bantul Regency, 2018/2019 Academic Year,” Thesis. Yogyakarta State University, 2019.
W. Walidin, “Directions of Human Resource Development in the Dimensions of Islamic Education”. Journal of Education, vol. 2, no. 2, pp. 147–163, 2016.
Y. D. Prastika, “The Effect of Reliability Validity and Difficulty Level on the Quality of Economic Questions Using Anates Software at SMKN 3 Bangkalan,” Doctoral dissertation, STKIP PGRI BANGKALAN, 2021.
Z. H. Siregar, “Implementation of Macro Excel (VBA) as a Registration Information System and Monitoring of Hajj Bailout at PT. Bank Mandiri Cab. Ternate”. IESM Journal, vol. 1, no. 1, pp. 48-67, 2019.
Authors who publish with this Journal agree to the following terms:
- Author retain copyright and grant the journal right of first publication with the work simultaneously licensed under a creative commons attribution license that allow others to share the work within an acknowledgement of the work’s authorship and initial publication of this journal.
- Authors are able to enter into separate, additional contractual arrangement for the non-exclusive distribution of the journal’s published version of the work (e.g. acknowledgement of its initial publication in this journal).
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their websites) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published works.
