THE QUALITY OF ISLAMIC RELIGIOUS EDUCATION TEST ITEMS IN VOCATIONAL HIGH SCHOOLS
DOI:
https://doi.org/10.30868/ei.v15i03.10678Keywords:
Asesmen,Butir Soal,ValiditasAbstract
Learning outcomes evaluation through summative assessment plays a crucial role in accurately capturing student competency achievement. However, field practices indicate that test instruments are frequently developed without meticulous psychometric testing, thereby triggering measurement distortion. This study aims to map the distribution of valid and invalid test items, as well as to identify the root causes of instrument invalidity across the dimensions of content, construction, and language readability. The research method employed is a descriptive quantitative approach integrated with qualitative content analysis. Data collection was conducted through documentation of the summative test manuscript for the Islamic Religious Education and Character (PAI-BP) subject of Class XI in the Light Vehicle Engineering (TKR) department at SMK Negeri Karangpucung, along with the response data from 35 students. The data were tabulated into a binary matrix (scores of 1 and 0) and analyzed quantitatively using Excel formulas assisted by SPSS software, then compared against an r-table value of 0.334. The results demonstrated that out of the 30 multiple-choice items tested, 14 items were declared valid and 16 items were declared invalid or discarded, including an anomaly of two test items yielding negative (minus) correlation coefficients. The root causes of invalidity were identified as non-homogeneous distractors, biased stems, typographical errors, and overly lengthy text stimuli that induced reading fatigue among vocational students. The implications of this study emphasize the urgency for educators to conduct a total reconstruction of flawed item banks and to formulate more concise, applicable questions to uphold accountability and fairness within the school assessment system.
References
Agustina, I. P., & Yuana, O. A. (2025). Peran Evaluasi Dalam Meningkatkan Kualitas Pendidikan Agama Islam Di Era Digital. Al-Fatih: Jurnal Pendidikan Dan Keislaman, 8(1), 250–272.
Anshari, M. I., Nasution, R., Irsyad, M., Alifa, A. Z., & Zuhriyah, I. A. (2024). Analisis Validitas Dan Reliabilitas Butir Soal Sumatif Akhir Semester Ganjil Mata Pelajaran Pai. Edukatif : Jurnal Ilmu Pendidikan, 6(1), 964–975. Https://Doi.Org/10.31004/Edukatif.V6i1.5931
Artosandi, Y. S. R., Prijowuntato, S. W., & Abdul Kadir, N. B. (2025). Empowering Career Exploration: Designing A Vocational Interest Instrument For Junior High School Students. Jurnal Penelitian Dan Evaluasi Pendidikan, 29(2), 154–166. Https://Doi.Org/10.21831/Pep.V29i2.84561
Başer, A., Sönmez, Ö. F., Kürklü Arpaçay, D., & Şahin, H. (2025). Adapting Organizational Culture Scale Into Healthcare Professional Education: A Scale Validity And Reliability Analysis. Human Resources For Health, 23(1). Https://Doi.Org/10.1186/S12960-025-01006-2
Chotijah, H., Suparman, & Kusumaningtyas, D. A. (2025). Beyond Technocratic Competence: A Psychometric Validation Of A Values-Embedded Teacher Assessment Model In Indonesian Islamic Schools. Jurnal Pendidikan Agama Islam, 22(2), 585–604. Https://Doi.Org/10.14421/Jpai.V22i2.12965
Darmayanti, H. (2019). Evaluasi Pendidikan. Jurnal Edukatif, V(1), 58–65.
Jamalia, J., Huriyah, L., & Yuliati, W. (2022). E-Report Application: The Role Of Stakeholders In The Assessment System In Schools. Al-Tanzim: Jurnal Manajemen Pendidikan Islam, 6(4), 999–1009. Https://Doi.Org/10.33650/Al-Tanzim.V6i4.3112
Kadir, A., & Umiarso. (2021). Evaluation Of The Application Of Distance Learning Programs In Madrasah Aliyah Malang Regency. Jurnal Pendidikan Agama Islam, 18(1), 109–124. Https://Doi.Org/10.14421/Jpai.2021.181-06
Krisnawati, E., Artanti, K. D., & Umar, N. H. (2024). Uji Validitas Dan Reliabilitas Instrumen Penelitian Dukungan Suami Terhadap Hambatan Penggunaan Metode Kontrasepsi Jangka Panjang Pada Multipara Akseptor Aktif Di Surabaya. Media Gizi Kesmas, 13(2), 659–664. Https://Doi.Org/10.20473/Mgk.V13i2.2024.659-664
Magdalena, I., Fauziah, S. N., Faziah, S. N., & Nupus, F. S. (2021). Analisis Validitas, Reliabilitas, Tingkat Kesulitan Dan Daya Beda Butir Soal. Bintang : Jurnal Pendidikan Dan Sains, 3(2), 198–214. Retrieved From Https://Ejournal.Stitpn.Ac.Id/Index.Php/Bintang
Ninghardjanti, P., & Dirgatama, C. H. A. (2021). Building Critical Thinking Skills Through A New Design Mobile-Based Interactive Learning Media Knowledge Framework. International Journal Of Interactive Mobile Technologies, 15(17), 49–68. Https://Doi.Org/10.3991/Ijim.V15i17.23801
Puspita, A., & Sari, I. (2024). Validitas Dan Reliabilitas Soal Ujian Sumatif Tengah Semester ( Sts ) Kelas X Fase-E Sma Negeri 8 Palembang Tahun Pelajaran 2023 / 2024. Alfabeta: Jurnal Bahasa, Sastra, Dan Pembelajarannya, 7(2), 337–347.
Putri, M. A., Kuhon, F. V., & Palandeng, H. M. F. (2024). Uji Validitas Dan Reliabilitas Instrumen Penelitian. Jurnal Kedokteran Komunitas Dan Tropik, 12(2), 635–640. Https://Doi.Org/10.35790/Jkkt.V12i2.59634
Rahdiyanta, D., Nurhadiyanto, D., & Munadi, S. (2019). The Effects Of Situational Factors In The Implementation Of Work-Based Learning Model On Vocational Education In Indonesia. International Journal Of Instruction, 12(3), 307–324. Https://Doi.Org/10.29333/Iji.2019.12319a
Raihanan Syafiq, S. N., Alwi, J. L., & Zuhriah, I. A. (2024). Teknik Analisis Validitas Tes Menggunakan Spss Dalam Mengukur Kemampuan Hasil Belajar Materi Ski Kelas Xi Sma. Afeksi: Jurnal Penelitian Dan Evaluasi Pendidikan, 5(6), 1020–1030. Https://Doi.Org/10.59698/Afeksi.V5i6.388
Rifka Alkhilyatul Ma’rifat, I Made Suraharta, I. I. J. (2024). Analisis Validasi Soal Tes Hasil Belajar Pada Pelaksanaan Pembelajaran Bahasa Arab Di Pusat Pengembangan Bahasa (P3b) Uin Suska Riau. 2, 306–312.
Saepuzaman, D., Istiyono, E., Haryanto, & Retnawati, H. (2025). Characteristics Of Two-Tier Multiple Choice (Ttmc) High Order Thinking Skill (Hots) Instruments And The Estimation Of Hots Abilities Of Vocational Education Students Using The Item Response Theory Approach. Journal Of Engineering Education Transformations, 38(Special Issue), 13–22. Https://Doi.Org/10.16920/Jeet/2025/V38is3/25086
Salamatov, A., Gafarova, E., Belevitin, V., Gafarov, M., & Gordeeva, D. (2021). Machine Learning Methods And Qualimetric Approach To Determine The Conditions For Train Students In The Field Of Environmental And Economic Activities. International Journal Of Emerging Technologies In Learning, 16(3), 72–85. Https://Doi.Org/10.3991/Ijet.V16i03.17715
Sridharan, K., & Sivaramakrishnan, G. (2025). Angoff Methods In Standard Setting In Health Professional Education: A Systematic Review And Meta-Analysis. Bmc Medical Education, 25(1). Https://Doi.Org/10.1186/S12909-025-08300-6
Susilana, R., & Rosliana, L. (2025). Curriculum Evaluation In Tourism Education : Assessing The Fulfillment Of Obe Principles. 29(2), 240–255.
Yolnasdi, Simatupang, W., Sukardi, & Fadillah, R. (2025). Effectiveness Of Project-Based Cooperative Learning Model In Electrical Installation Practical Courses. Salud, Ciencia Y Tecnologia, 5. Https://Doi.Org/10.56294/Saludcyt20251779
Yulastri, A., Ganefri, Fiandra, Y. A., Ferdian, F., Elfizon, Samala, A. D., … Zahari, M. S. M. (2025). Building The Next Generation Of Digital Entrepreneurs: Lessons From Indonesian Vocational Students. Salud, Ciencia Y Tecnologia, 5. Https://Doi.Org/10.56294/Saludcyt20252111
Zuhri, A., Ramírez-Coronel, A. A., Al-Hawary, S. I. S., Dwijendra, N. K. A., Muda, I., Pallathadka, H., … Sunarsi, D. (2023). Evaluation Of The Role Of Islamic Lifestyle In Communication Skills Of Muslim Couples. Hts Teologiese Studies / Theological Studies, 79(1), 1–6. Https://Doi.Org/10.4102/Hts.V79i1.8185
Downloads
Published
Issue
Section
Citation Check
License
Copyright (c) 2026 Mifta Ghina Dzakiya, Tarsono; Zahra Uswah Hasanah; Ahmad Abdul Majid, Dadan Rusmana
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
