Analysis of Instrument Quality for Measuring High School Students’ Conceptual Understanding of Global Warming
DOI:
https://doi.org/10.29303/goescienceed.v7i3.2453Keywords:
Rasch Model, Concept Comprehension Instrument, Global Warming, Validity, ReliabilityAbstract
Conceptual understanding of global warming is essential for enabling students to explain environmental phenomena scientifically and apply physics concepts to real-world issues; therefore, a valid and reliable assessment instrument is needed. This study aimed to analyze the quality of a test instrument measuring high school students' conceptual understanding of global warming using the Rasch Model. A descriptive quantitative approach was employed involving 43 eleventh-grade students from a public high school in Bandung selected through purposive sampling. The instrument consisted of 20 multiple-choice items based on the Revised Bloom's Taxonomy at the C2 level. Data were analyzed using MINISTEP. The results showed that the instrument satisfied the unidimensionality assumption, with 50.9% raw variance explained by measures and 6.7% unexplained variance in the first contrast. Item fit analysis identified 9 highly suitable items, 7 suitable items, 1 less suitable item, and 3 unsuitable items. Reliability analysis yielded person reliability of 0.63, item reliability of 0.93, and Cronbach's alpha of 0.71. Therefore, the instrument is generally suitable for measuring students' conceptual understanding of global warming, although several items require revision
References
Aini, E., Evendi, E., Halim, A., Syukri, M., & Yusrizal, Y. (2023). Relationship between misconceptions and students’ scientific literacy abilities on global warming material. Jurnal Penelitian Pendidikan IPA, 9(10), 8051–8058. https://doi.org/10.29303/jppipa.v9i10.5156
Amelia, A., Muslim, M., & Chandra, A. F. (2020). Karakteristik instrumen non-tes sustainability awareness menggunakan analisis Rasch model materi pemanasan global untuk siswa sekolah menengah. WaPFi: Wahana Pendidikan Fisika, 5(2). https://doi.org/10.17509/wapfi.v5i2.27431
Amiruddin, M. Z. B., Samsudin, A., Suhandi, A., Kaniawati, I., Coştu, B., Aminuddin, A. H., & Kurniawan, F. (2023). Validity and Reliability of the Global Warming Instrument: A Pilot Study Using Rasch Model Analysis. Jurnal Pendidikan MIPA, 24(4), 912–922. https://doi.org/10.23960/jpmipa/v24i4.pp912-922
Bintang, R. S., & Suprananto. (2024). The Impact of Sample Size, Test Length, and Person-Item Targeting on The Separation Reliability in Rasch Model: A Simulation Study. Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 13(1), 1–13. https://doi.org/10.15408/jp3i.v13i1.27975
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd ed.). Routledge.
Boone, W. J. (2016). Rasch analysis for instrument development: Why,when,and how? CBE Life Sciences Education, 15(4). https://doi.org/10.1187/cbe.16-04-0148
Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Analisis Kualitas Soal Kemampuan Membedakan Rangkaian Seri Dan Paralel Melalui Teori Tes Klasik Dan Model Rasch. Indonesian Journal Of Educational Research and Review, 3(1), 11. https://doi.org/10.23887/ijerr.v3i1.24080
Johnson, & Christensen. (2020). Educational research: Quantitative, qualitative, and mixed approaches. SAGE Publications.
Khatmani, F. K., Liliawati, W., & Imansyah, H. (2024). Analisis pemahaman konsep fisika siswa smp pada materi suhu dan kalor menggunakan tes isomorfik : Rasch model. WaPFi (Wahana Pendidikan Fisika), 9(1), 11–18. https://doi.org/10.17509/wapfi.v9i1.52655
Linacre, J. M. (2012). A User’s Guide to Winsteps Ministep Rasch-Model Computer Programs. Winsteps.com.
Loh, S. L., Jamil, N. A., & Thoe, N. K. (2022). Establishing the Validity and Reliability of a Program Evaluation Questionnaire using Rasch Measurement Model. Dinamika Jurnal Ilmiah Pendidikan Dasar, 14(2), 149. https://doi.org/10.30595/dinamika.v14i2.14786
Martha, E., Besral, Zainita, U. H., Rilfi, N. A., & Aminudin, S. A. (2025). Adolescents’ Knowledge on Climate Change: A Nationwide Study in Indonesia. International Journal of Environmental Research and Public Health, 22(4), 571. https://doi.org/10.3390/ijerph22040571
Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(2). https://doi.org/10.1103/PhysRevPhysEducRes.15.020111
Rahmawati, F. (2023). Meningkatkan Hasil Belajar Siswa Materi Pemanasan Global: Penggunaan Media Pembelajaran Puzzle Maker. Indonesian Journal of Action Research, 2(1), 43–48. https://doi.org/10.14421/ijar.2023.21-06
Rasyid, F., Istiyono, E., & Gunawan, C. W. (2025). Developing and analyzing items of a physics conceptual understanding test on wave topics for high school students using the Rasch Model. REID (Research and Evaluation in Education), 11(1), 1–16. https://doi.org/10.21831/reid.v11i1.75575
Ridwan, I. M., Kaniawati, I., Suhandi, A., Ramalis, T. R., Mahmudah, I. R., & Vilmala, B. K. (2023). Rasch Modeling: Developing A Critical Thinking Ability Test for Students on Climate Change Material. Momentum: Physics Education Journal, 7(2), 247–258.
Rosli, R., Abdullah, M., Siregar, N. C., Abdul Hamid, N. S., Abdullah, S., Beng, G. K., … Bais, B. (2020). Student Awareness of Space Science: Rasch Model Analysis for Validity and Reliability. World Journal of Education, 10(3), 170. https://doi.org/10.5430/wje.v10n3p170
Saputri, H. A., Zulhijrah, Larasati, N. J., & Shaleh. (2023). Analisis Instrumen Assesmen: Validitas, Reliabilitas, Tingkatkesukaran Dan Daya Pembeda. Didatik: Jurnal Ilmiah PGSD FKIP Universitas Mandiri, 09(05), 2986–2995.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan RASCH pada. (155), 50–51.
Susongko, P., Ratu, I. M., & Hayati, M. N. (2021). Tes Kemampuan Berfikir Tingkat Tinggi untuk Mengukur Literasi Lingkungan Hidup bagi Siswa Sekolah Menengah Pertama dengan Aplikasi Model Rasch. PSEJ (Pancasakti Science Education Journal), 6(2), 93–101.
Wandi, W., Mardianti, F., Suwarma, I. R., & Liliawati, W. (2023). Theory and Practice of Conceptual Understanding in Physics Education: A Literature Review and Bibliometric Analysis of the Recent Decades. Kasuari: Physics Education Journal (KPEJ), 6(2), 107–117. https://doi.org/10.37891/kpej.v6i2.483
