Aiken’s V analysis and Rasch modeling to determine the quality of physics creative thinking test instruments
DOI:
https://doi.org/10.12928/jrkpf.v12i1.1161Keywords:
Aiken’s V , creative thinking , Rasch Model, test instrumentAbstract
Creative thinking ability is one of the important high-level thinking skills. To assess this ability, a measurement instrument in the form of a test is needed. Therefore, the study aims to evaluate the validity of the content and constructs that measure creative thinking ability using Aiken’s V index analysis and Rasch modeling. The study used a quantitative descriptive method by assessing 12 test items on the measurement material, climate change, and renewable energy. Five experts assessed material, construction, and language, and a trial was conducted on 134 student samples. The results showed that all questions were valid. Undimensionality showed results of less than 15%, the level of item suitability was stated as appropriate, and the difficulty level varied in 4 categories. The Cronbach Alpha value was 0.77, and the person and item reliability was 0.76 and 0.92, respectively. These results indicate that the test is a reliable evaluation tool and a basis for developing similar instruments. It also has practical implications in designing learning to develop students' creative thinking.
References
[1] OECD, PISA 2022 Results (Volume III): Creative Minds, Creative Schools. in PISA. Paris: OECD Publishing, 2024. doi: https://doi.org/10.1787/765ee8c2-en
[2] N. Podungge, D. D. Paramata, and A. H. Odja, "Penerapan E-Learning Berbantuan Media Pembelajaran Edmodo Terhadap Hasil Belajar Siswa pada Konsep Gejala Pemanasan Global," Konstan - Jurnal Fisika dan Pendidikan Fisika, vol. 5, no. 2, pp. 77-85, Dec. 2020, doi: https://doi.org/10.20414/konstan.v5i2.55
[3] D. K. Fitra, "Pembelajaran Berdiferensiasi dalam Perspektif Progresivisme pada Mata Pelajaran IPA," Jurnal Filsafat Indonesia, vol. 5, no. 3, pp. 250-258, Oct. 2022, doi: https://doi.org/10.23887/jfi.v5i3.41249
[4] L. Charli, A. Amin, and D. Agustina, "Kesulitan Siswa dalam Menyelesaikan Soal Fisika pada Materi Suhu dan Kalor di Kelas X SMA Ar-Risalah Lubuklinggau Tahun Pelajaran 2016/2017," Journal of Education and Instruction (JOEAI), vol. 1, no. 1, pp. 42-50, Jun. 2018, doi: https://doi.org/10.31539/joeai.v1i1.239
[5] S. Fajrina, L. Lufri, and Y. Ahda, "Science, Technology, Engineering, and Mathematics (STEM) as A Learning Approach to Improve 21st Century Skills: A Review," International Journal of Online and Biomedical Engineering (iJOE), vol. 16, no. 07, pp. 95-104, Jun. 2020, doi: https://doi.org/10.3991/ijoe.v16i07.14101
[6] M. P. Simanjuntak, N. Bukit, Y. D. A. Sagala, R. K. Putri, Z. L. Utami, and M. Motlan, "Desain Pembelajaran Berbasis Proyek Terhadap 4C," Inpafi: Inovasi Pembelajaran Fisika, vol. 7, no. 3, pp. 38-46, 2019, doi: https://doi.org/10.24114/inpafi.v7i3.14570.
[7] D. Sambada, "Peranan Kreativitas Siswa Terhadap Kemampuan Memecahkan Masalah Fisika dalam Pembelajaran Kontekstual," Jurnal Penelitian Fisika dan Aplikasinya (JPFA), vol. 2, no. 2, p. 37, Dec. 2012, doi: https://doi.org/10.26740/jpfa.v2n2.p37-47
[8] M. A. Runco and S. Acar, "Divergent Thinking as an Indicator of Creative Potential," Creat Res J, vol. 24, no. 1, pp. 66-75, Jan. 2012, doi: https://doi.org/10.1080/10400419.2012.652929
[9] I. Tiyaswati, "Pengembangan Perangkat Pembelajaran IPA Dengan Pendekatan Scientific dan Model Search, Solve, Create and Share (SSCS) Untuk Meningkatkan Keterampilan 4CS (Communication, Collaboration, Critical Thinking and Creativity) Siswa," Universitas Sebelas Maret, 2021. [Online]. Available: https://digilib.uns.ac.id/dokumen/detail/89626/Pengembangan-Perangkat-Pembelajaran-IPA-Dengan-Pendekatan-Scientific-dan-Model-Search-Solve-Create-and-Share-SSCS-Untuk-Meningkatkan-Keterampilan-4CS-Communication-Collaboration-Critical-Thinking-and-Creativi
[10] B. I. N. Obi, T. I. Eze, and N. F. Chibuzo, "Experiential learning activities in business education for developing 21st century competencies," Journal of Education for Business, vol. 97, no. 1, pp. 36-42, Jan. 2022, doi: https://doi.org/10.1080/08832323.2021.1884521
[11] U. Munandar, Pengembangan kreativitas anak berbakat. Jakarta: Rineka cipta, 2014.
[12] W. Hu and P. Adey, "A scientific creativity test for secondary school students," Int J Sci Educ, vol. 24, no. 4, pp. 389-403, Apr. 2002, doi: https://doi.org/10.1080/09500690110098912
[13] M. H. Tumangger, K. Kartono, and S. Ridlo, "Analisis Kebutuhan Pengembangan Instrumen Penilaian Kemampuan Berpikir Kreatif pada Mata Pelajaran Matematika untuk Siswa Sekolah Dasar," Basicedu Journal, vol. 6, no. 5, pp. 9170-9179, 2022, doi: https://doi.org/10.31004/basicedu.v6i5.3623.
[14] R. Widyatiningtyas, B. A. Sritumini, and S. Rohartati, "Pembuatan Alat Tes Kemampuan Berpikir Kreatif Bagi Guru SMP Kemala Bhayangkari Bandung," Jurnal Pengabdian Tri Bhakti, vol. 3, no. 1, pp. 52-56, Jun. 2021, doi: https://doi.org/10.36555/tribhakti.v3i1.1703
[15] A. N. Solihat, ""Pengembangan instrumen berpikir kreatif menggunakan item response theory (IRT) dalam pembelajaran ekonomi dengan model konstruktivis," Universitas Pendidikan Indonesia, 2024. [Online]. Available: http://repository.upi.edu/123662/1/D_PEKO_2104932_TITLE.pdf
[16] R. P. Z, R. Sari, J. Jumadi, and A. Ariswan, "Pengembangan dan Validasi Instrumen Tes untuk Mengukur Keterampilan Menyelesaikan Masalah Peserta Didik SMA pada Pelajaran Fisika," Jurnal Penelitian Pembelajaran Fisika, vol. 11, no. 1, pp. 17-26, Mar. 2020, doi: https://doi.org/10.26877/jp2f.v11i1.3993
[17] Aulia Sefti Rahmadhani and Selvia Erita, "Pengembangan Dan Uji Validitas Soal-Soal Kemampuan Pemahaman Konsep Pada Materi Soal Himpunan," Jurnal Bima : Pusat Publikasi Ilmu Pendidikan bahasa dan Sastra, vol. 2, no. 1, pp. 139-147, Jan. 2024, doi: https://doi.org/10.61132/bima.v2i1.553
[18] S. Yusuf, N. Budiman, E. S. Yudha, D. Suryana, and S. M. J. B. Yusof, "Rasch Analysis of the Indonesian Mental Health Screening Tools," Open Psychol J, vol. 14, no. 1, pp. 198-203, Sep. 2021, doi: 10.2174/1874350102114010198, doi: https://doi.org/10.2174/1874350102114010198
[19] H. Y. Muslihin, D. Suryana, A. Ahman, U. Suherman, and T. H. Dahlan, "Analysis of the Reliability and Validity of the Self-Determination Questionnaire Using Rasch Model," International Journal of Instruction, vol. 15, no. 2, pp. 207-222, Apr. 2022, doi: https://doi.org/10.29333/iji.2022.15212a
[20] D. Indihadi, D. Suryana, and A. B. Ahmad, "The Analysis of Construct Validity of Indonesian Creativity Scale using Rasch Model," Creativity Studies, vol. 15, no. 2, pp. 560-576, Aug. 2022, doi: https://doi.org/10.3846/cs.2022.15182
[21] L. Nur, A. Yulianto, D. Suryana, A. A. Malik, M. A. Al Ardha, and F. Hong, "An Analysis of the Distribution Map of Physical Education Learning Motivation through Rasch Modeling in Elementary School," International Journal of Instruction, vol. 15, no. 2, pp. 815-830, Apr. 2022, doi: https://doi.org/10.29333/iji.2022.15244a
[22] I. H. Yakin, Metodologi Penelitian (Kuantitatif & Kualitatif). Garut: Aksara Global Akademia, 2023.
[23] Agustini et al., Metode Penelitian Kualitatif: Teori dan Panduan Praktis Analisis Data Kualitatif. Mifandi Mandiri Digital, 2024.
[24] "Torrance Tests of Creative Thinking," in The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation, 2455 Teller Road, Thousand Oaks, California 91320: SAGE Publications, Inc., 2018. doi: https://doi.org/10.4135/9781506326139.n705
[25] L. R. Aiken, "Three Coefficients for Analyzing the Reliability and Validity of Ratings," Educ Psychol Meas, vol. 45, no. 1, pp. 131-142, Mar. 1985, doi: https://doi.org/10.1177/0013164485451012
[26] B. Sumintono and W. Widhiarso, Aplikasi Pemodelan Rasch: pada Assessment Pendidikan. Penerbit Trim Komunikata, 2015.
[27] N. R. An Nabil, I. Wulandari, S. Yamtinah, S. R. D. Ariani, and M. Ulfa, "Analisis Indeks Aiken untuk Mengetahui Validitas Isi Instrumen Asesmen Kompetensi Minimum Berbasis Konteks Sains Kimia," PAEDAGOGIA, vol. 25, no. 2, p. 184, Sep. 2022, doi: https://doi.org/10.20961/paedagogia.v25i2.64566
[28] H. Retnawati, Validitas Reliabilitas & Karakteristik Butir. Yogyakarta: Parama Publishing, 2020.
[29] G. Engelhard, Jr. and J. Wang, Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences. New York: Routledge, 2024. doi: https://doi.org/10.4324/9781003458746
[30] C. Han, "Rasch Analysis in the Human Sciences," Journal of Research Design and Statistics in Linguistics and Communication Science, vol. 5, no. 1-2, pp. 208-211, Dec. 2019, doi: https://doi.org/10.1558/jrds.37535
[31] T. G. Bond and C. M. Fox, Applying the Rasch Model : Fundamental Measurement in the Human Sciences. Psychology Press, 2013. doi: https://doi.org/10.4324/9781410614575
[32] L. SÜRÜCÜ and A. MASLAKÇI, "Validity and Reliability in Quantitative Research," Business & Management Studies: An International Journal, vol. 8, no. 3, pp. 2694-2726, Sep. 2020, doi: https://doi.org/10.15295/bmij.v8i3.1540
[33] S. S. Fahmina, M. Masykuri, D. G. Ramadhani, and S. Yamtinah, "Content validity uses Rasch model on computerized testlet instrument to measure chemical literacy capabilities," 2019, p. 020023. doi: https://doi.org/10.1063/1.5139755
[34] S. Azwar, "Reliabilitas dan Validitas Aitem," Buetin Psikologi, vol. 3, no. 1, 1995, [Online]. Available: https://jurnal.ugm.ac.id/buletinpsikologi/article/view/13381/9595
[35] S. Azwar, Reliabilitas dan validitas. Pustaka Pelajar, 2012.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Kurniawan Kurniawan, Parlindungan Sinaga, Duden Saepuzaman
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
