Four-Tier Assessment for Islamic Religious Education in Sports: Development and Preliminary Psychometric Evaluation

Abstract

Background:  Four-tier assessments can distinguish answers, reasoning, and confidence, but their use in Islamic Religious Education and sports education remains limited. This study focuses on instrument development and preliminary psychometric evaluation using partial least squares structural equation modeling (PLS SEM), rather than diagnostic prevalence.

Aims: This study aimed to develop a 12-item four-tier assessment covering Akhlaq, Fiqh, Tawhid, and Quranic Studies in sports contexts and to evaluate preliminary first-order measurement evidence.

Methods: Using a research and development approach, the instrument was constructed through curriculum document analysis, concept mapping, open-ended pre-testing with 62 students, distractor development, and prototype assembly. A separate sample of 250 sports education students completed the prototype version. The available analysis matrix was examined using first-order PLS-SEM with SmartPLS 4 Pro.

Results: All 12 indicators loaded significantly on their intended first-order domains. Composite reliability ranged from 0.754 to 0.777, average variance extracted ranged from 0.507 to 0.537, and heterotrait-monotrait ratios ranged from 0.320 to 0.648. Cronbach's alpha was modest, ranging from 0.510 to 0.569, indicating weak within-domain covariance. Keyed option positions were also strongly unbalanced, creating a position cue that constrains interpretation of the estimates.

Conclusion: The study provides preliminary first-order psychometric evidence for a four-tier assessment in an interdisciplinary socio-religious context. Because separate tier responses are not retained, observed diagnostic-category prevalence is not reported. Stronger validation requires raw tier-level responses, a documented scoring transformation, less transparent distractors, balanced key positions, and independent item response theory or Rasch analysis.

References

Aksoy, A. C. A., & Erten, S. (2022). A four-tier diagnostic test to determine pre-service science teachers’ misconceptions about global warming. Journal of Baltic Science Education, 21(5), 747-761. https://doi.org/10.33225/jbse/22.21.747

Al-Lawama, M., & Kumwenda, B. (2023). Decreasing the options’ number in multiple choice questions in the assessment of senior medical students and its effect on exam psychometrics and distractors’ function. BMC Medical Education, 23(1), 212. https://doi.org/10.1186/s12909-023-04206-3

Andriani, F., Indrowati, M., & Sugiharto, B. (2021). Analysis items of the four-tier immune system multiple choice test instrument using Rasch model. Biosfer: Jurnal Pendidikan Biologi, 14(1), 99-119. https://doi.org/10.21009/biosferjpb.18020

Aripiani, S. K., Samsudin, A., Kaniawati, I., Novia, H., Aminudin, A. H., Sutrisno, A. D., & Costu, B. (2023). Diagnostic instruments of four-tier test work and energy (FORTUNE) to identify the level of students’ conceptions. Tadris: Jurnal Keguruan Dan Ilmu Tarbiyah, 8(1), 19-32. https://doi.org/10.24042/tadris.v8i1.13524

Astuti, I. A. D., Bhakti, Y. B., Prasetya, R., & Zulherman, Z. (2023). Android-based 4-tier physics test app to identify student misconception profiles. International Journal of Evaluation and Research in Education, 12(3), 1356-1363. https://doi.org/10.11591/ijere.v12i3.25536

Atika, Y., Rahmaniar, Y., Muslim, M., Wanto, D., & Daheri, M. (2023). Formative Test Analysis of Islamic Religious Education Learning Evaluation Practices (Study at SMP Negeri 1 Muara Kemumu). Indonesian Journal of Pedagogy and Teacher Education, 1(2), 38–42. https://doi.org/10.58723/ijopate.v1i2.113

Aygun, Y., Boke, H., Yagin, F. H., Tufekci, S., Murathan, T., Gencay, E., Prieto-González, P., & Ardigò, L. P. (2024). Emotional and Social Outcomes of the Teaching Personal and Social Responsibility Model in Physical Education: A Systematic Review and Meta-Analysis. Children (Basel, Switzerland), 11(4). https://doi.org/10.3390/children11040459

Barnard, J. J. (2025). A solution to guessing in multiple-choice questions: A new paradigm for (medical) assessment. International Journal of Health and Pharmaceutical Research, 10(12), 1-13. https://doi.org/10.56201/ijhpr.vol.10.no12.2025.pg1.13

Bisa, M. (2023). Sports education as a means of building students’ character: Values and benefits. Al-Ishlah: Jurnal Pendidikan, 15(2), 1581-1590. https://doi.org/10.35445/alishlah.v15i2.3889

Bronikowska, M., Mouratidou, K., Ludwiczak, M., Karamavrou, S., McKeel, C., & Bronikowski, M. (2024). Systematic review on social/moral competence interventions in physical education. Biomedical Human Kinetics, 16(1), 55-77. https://doi.org/10.2478/bhk-2024-0007

Bryce, T. G. K., & Blown, E. J. (2024). Ausubel’s meaningful learning re-visited. Current Psychology, 43(5), 4579–4598. https://doi.org/10.1007/s12144-023-04440-4

Dai, J., Chen, J., Huang, Z., Chen, Y., Li, Y., Sun, J., Li, D., Lu, M., Chen, J., & Tilga, H. (2024). Age-effects of sport education model on basic psychological needs and intrinsic motivation of adolescent students: A systematic review and meta-analysis. PLOS ONE, 19(5), e0297878. https://doi.org/10.1371/journal.pone.0297878

Desstya, A., Sayekti, I. C., Abduh, M., & Sukartono, S. (2025). Development of a four-tier diagnostic test for misconceptions in natural science of primary school pupils. Journal of Turkish Science Education, 22(2), 338-353. https://doi.org/10.36681/tused.2025.017

Do, H.-N., Do, B. N., & Nguyen, M. H. (2023). 3How do constructivism learning environments generate better motivation and learning strategies? The Design Science Approach. Heliyon, 9(12). https://doi.org/10.1016/j.heliyon.2023.e22862

Duran, T., & Dikmenli, M. (2024). Use of Multi-Tier Concept Diagnostic Tests in Biology Education: A Systematic Review of the Literature. Journal of Education in Science, Environment and Health, 10(4), 224–244. https://doi.org/10.55549/jeseh.755

Ginanjar, M. H., Rahman, Hidayat, R., & Halim, A. A. (2025). The implementation of Islamic religious education in efforts to shape Islamic character and develop students’ talents and interests. Edukasi Islami: Jurnal Pendidikan Islam, 14(2), 281–292. https://doi.org/10.30868/ei.v14i01.7732

Habiddin, H., & Page, E. M. (2019). Development and validation of a four-tier diagnostic instrument for chemical kinetics (FTDICK). Indonesian Journal of Chemistry, 19(3), 720-736. https://doi.org/10.22146/ijc.39218

Hair, J., & Alamer, A. (2022). Partial Least Squares Structural Equation Modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 1–16. https://doi.org/10.1016/j.rmal.2022.100027

Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). Sage. https://uk.sagepub.com/en-gb/eur/a-primer-on-partial-least-squares-structural-equation-modeling-pls-sem/book270548

Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. In European Business Review (Vol. 31, Issue 1, pp. 2–24). Emerald Group Publishing Ltd. https://doi.org/10.1108/EBR-11-2018-0203

Hull, M. M., Jansky, A., & Hopf, M. (2022). Does Confidence in a Wrong Answer Imply a Misconception? Physical Review Physics Education Research, 18(2), 20108. https://doi.org/10.1103/PhysRevPhysEducRes.18.020108

Imaduddin, M., Shofa, M. M., Riza, M. F., & Fikri, A. A. (2023). Exploring the Pre-Service Basic Science Teachers’ Misconceptions Using the Six-Tier Diagnostic Test. International Journal of Evaluation and Research in Education, 12(3), 1626–1636. https://doi.org/10.11591/ijere.v12i3.24603

Isra, R. A., & Mufit, F. (2023). Students’ Conceptual Understanding and Causes of Misconceptions on {Newton}’s Law. International Journal of Evaluation and Research in Education, 12(4), 1914–1924. https://doi.org/10.11591/ijere.v12i4.25568

Istiyono, E., Dwandaru, W. S. B., Fenditasari, K., Ayub, M. R. S. S. N., & Saepuzaman, D. (2023). The development of a four-tier diagnostic test based on modern test theory in physics education. European Journal of Educational Research, 12(1), 371-385. https://doi.org/10.12973/eu-jer.12.1.371

Jadwiszczak, M., Wawrzyniak, S., & Pezdek, K. (2025). More than movement: A systematic review of moral and social development in adolescents’ physical education. BMC Public Health, 25(1), 2076. https://doi.org/10.1186/s12889-025-23169-2

Jani, E., Yono, T., & Nurhasyim, M. (2025). Sports learning methods based on Islamic values. Gladi : Jurnal Ilmu Keolahragaan, 16(5), 269–274. https://doi.org/10.21009/GJIK.162.11

Judijanto, L., Siminto, S., & Rahman, R. (2024). The Influence of Religious Beliefs and Religious Practices on Social Cohesion in Modern Society in Indonesia. The Eastasouth Journal of Social Science and Humanities, 1(6), 139 – 150. https://doi.org/10.58812/esssh.v1i03.276

Kaltakci-Gurel, D., Eryilmaz, A., & McDermott, L. C. (2017). Development and application of a four-tier test to assess pre-service physics teachers’ misconceptions about geometrical optics. Research in Science & Technological Education, 35(2), 238-260. https://doi.org/10.1080/02635143.2017.1310094

Manninen, M., & Campbell, S. (2022). The effect of the Sport Education Model on basic needs, intrinsic motivation and prosocial attitudes: A systematic review and multilevel meta-analysis. European Physical Education Review, 28(1), 78-99. https://doi.org/10.1177/1356336X211017938

Putra, A. T. A., & Anhusadar, L. (2025). Survey of assessment techniques for religious and moral values in early childhood in Baruga Sub-district, Kendari City. EduBasic Journal: Jurnal Pendidikan Dasar, 7(1), 30-45. https://doi.org/10.17509/ebj.v7i1.82857

Rachmawati, D., Anjania, D., Lubis, M., Ali, A., Oktavianti, C., Wati, Y., Sabrina, L., Noviyanti, E., & Nihayah, A. (2024). The Role of Islamic Religious Education in Shaping the Character of Children in Banyuurip Village in the Digital Era. Prosiding Seminar Nasional Pendidikan Dan Agama, 5(5), 48–59. https://doi.org/10.55606/semnaspa.v5i1.2035

Rahayu, N. Y., Maulida, T., Lestari, A., & Surawan, S. (2026). Fostering Empathy and Positive Character in Elementary School Students Through the School Environment. Indonesian Journal of Pedagogy and Teacher Education, 4(2), 85–91. https://doi.org/10.58723/ijopate.v4i2.661

Sarstedt, M., Hair, J. F., Pick, M., Liengaard, B. D., Radomir, L., & Ringle, C. M. (2022). Progress in partial least squares structural equation modeling use in marketing research in the last decade. Psychology & Marketing, 39(5), 1035-1064. https://doi.org/10.1002/mar.21640

Shen, Y., Martinek, T., & Dyson, B. P. (2022). Navigating the Processes and Products of The Teaching Personal and Social Responsibility Model: A Systematic Literature Review. Quest, 74(1), 91–107. https://doi.org/10.1080/00336297.2021.2017988

Soeharto, S., & Csapó, B. (2022). Exploring Indonesian student misconceptions in science concepts. Heliyon, 8(9), e10720. https://doi.org/10.1016/j.heliyon.2022.e10720

Taber, K. (2019). Constructivism in Education: Interpretations and Criticisms from Science Education. In In Early childhood development: Concepts, methodologies, tools, and applications (pp. 312–342). IGI Global. https://doi.org/10.4018/978-1-4666-9634-1.ch006

Teh, W. L., Abdin, E., Asharani, P. V, Kumar, F. D., Roystonn, K., Wang, P., Shafie, S., Chang, S., Jeyagurunathan, A., Vaingankar, J. A., Sum, C. F., Lee, E. S., Dam, R. M., & Subramaniam, M. (2023). Measuring social desirability bias in a multi-ethnic cohort sample: Its relationship with self-reported physical activity, dietary habits, and factor structure. BMC Public Health, 23(1), 415. https://doi.org/10.1186/s12889-023-15309-3

Yan, Y. K., & Subramaniam, R. (2018). Using a Multi-Tier Diagnostic Test to Explore the Nature of Students’ Alternative Conceptions on Reaction Kinetics. Chemistry Education Research and Practice, 19(1), 213–226. https://doi.org/10.1039/C7RP00143F

Zhang, J., Soh, K. G., Bai, X., Anuar, M. A., & Xiao, W. (2024). Optimizing learning outcomes in physical education: A comprehensive systematic review of hybrid pedagogical models integrated with the Sport Education Model. PLOS ONE, 19(12), e0311957. https://doi.org/10.1371/journal.pone.0311957

Zhang, J., Xiao, W., Soh, K. G., Yao, G., Anuar, M. A. B., Bai, X., & Bao, L. (2024). The effect of the Sport Education Model in physical education on student learning attitude: A systematic review. BMC Public Health, 24(1), 949. https://doi.org/10.1186/s12889-024-18243-0

Author Biographies

Ari Tri Fitrianto, Universitas Islam Kalimantan Muhammad Arsyad Al-Banjari

Associate Professor, Sports Education Program, Faculty of Teacher Training and Education, Universitas Islam Kalimantan Muhammad Arsyad Al-Banjari, Banjarmasin, Indonesia. His research interests include physical education, motor skills, physical literacy, physical activity, and sports science.

Aulia Putri Yuliasti, Universitas Islam Kalimantan Muhammad Arsyad Al Banjari

Sports Education Program, Faculty of Teacher Training and Education, Universitas Islam Kalimantan Muhammad Arsyad Al-Banjari, Banjarmasin, Indonesia. Her research interests include sports education and physical education

Abdul Hafiz, Universitas Islam Kalimantan Muhammad Arsyad Al-banjari

Faculty of Islamic Studies, Universitas Islam Kalimantan Muhammad Arsyad Al-Banjari, Banjarmasin, Indonesia. His research interests include Islamic education, teacher education, and educational development.