Classpoint AI: Empirical Quality of Automatic Item Test Generator in Arabic Foreign Language Assessment

Risma Siti Istikomah; Mohamad Zaka  Al Farisi; Hikmah Maulani

doi:10.26555/insyirah.v8i1.13163

Authors

Risma Siti Istikomah Universitas Pendidikan Indonesia
Mohamad Zaka Al Farisi Universitas Pendidikan Indonesia
Hikmah Maulani Universitas Pendidikan Indonesia

DOI:

https://doi.org/10.26555/insyirah.v8i1.13163

Keywords:

Quality questions item, Artificial Intelligence, Classpoint, Reading Comprehension, Arabic Language Assessment

Abstract

Artificial Intelligence (AI) plays a significant role in education in the modern era. A platform called Classpoint AI (CAI) has been widely utilized across various educational levels and disciplines worldwide. Numerous studies have reported positive responses toward using CAI as an interactive learning medium and an automatic question generator based on Bloom’s Taxonomy. This study aims to analyze the quality of test items generated by CAI quantitatively. The accuracy of a test item must be empirically validated to ensure high-quality learning. A non-probability sampling technique, specifically total sampling, was employed to select 39 female students in Phase F as research participants. Data were collected through a test consisting of 14 multiple-choice questions created by CAI to assess reading comprehension proficiency in Arabic. An Ex-post facto method was used in this study, as the researcher did not modify the pre-programmed CAI system. Three software tools (SPSS, Anbuso, and Anates) were used to analyze the item quality, and teachervalidation was also included. The findings revealed that most of the test items generated by CAI were invalid and exhibited low reliability. The questions were predominantly classified as easy. CAI-generated items demonstrated poor discrimination power butcontained effective distractors. For foreign language learning, CAI-generated questions need to reconsider the complexity of the vocabulary used. Considering the widespread use of this platform among educators on an international scale, this study contributes a global perspective by highlighting the need for both developer evaluation and educator discernment in utilizing CAI.

References

Abumosa, M. (2024). University Students’ Perspectives on the Use of Interactive Presentation Technologies. International Journal of Technology in Education and Science (IJTES), 8(4), 645–667. https://doi.org/10.46328/ijtes.579

Akhmadi, M. (2021). Analisis Butir Soal Evaluasi Tema 1 Kelas 4 SDN Plumbungan Menggunakan Program Anates. Ed-Humanistics : Jurnal Ilmu Pendidikan, 6(1), 799–806. https://doi.org/10.33752/ed-humanistics.v6i1.1464

Akram, H., & Abdelrady, A. H. (2023). Application of ClassPoint Tool in Reducing EFL Learners Test Anxiety: An Empirical Evidence from Saudi Arabia. Journal of Computers in Education, 10(3), 529–547. https://doi.org/10.1007/s40692-023-00265-z

Amelia, M. A. (2016). Analisis Soal Tes Hasil Belajar High Order Thinking Skills (HOTS) Matematika Materi Pecahan untuk Kelas 5 Sekolah Dasar. Jurnal Penelitian, 20, 123–131.

Anshari, M. I., Nasution, R., Irsyad, M., Alifa, A. Z., & Zuhriyah, I. A. (2024). Analisis Validitas dan Reliabilitas Butir Soal Sumatif Akhir Semester Ganjil Mata Pelajaran PAI. Edukatif : Jurnal Ilmu Pendidikan, 6(1), 964–975. https://doi.org/10.31004/edukatif.v6i1.5931

Aregbesola, B. G. (2025). Impact of Artificial Intelligent Class-Point on the Academic Achievement of Secondary School Students in Chemistry. 2(1), 1–11. https://researchvision.us/index.php/cognify/article/view/164

Arifin, Z. (2015). Evaluasi Pembelajaran: Standar Penilaian menurut BNSP, Model Evaluasi, Instrumen Evaluasi, Penilaian Berbasis Kelas, Penilaian Portofolio, Analisis Kualitas Tes Refleksi Pelaksana Evaluasi. Remaja Rosdakarya. https://books.google.co.id/books?id=V15NMwEACAAJ

Arikunto, S. (2013). Metode Penelitian Kuantitatif Kualitatif dan R&D. Alfabeta.

Arikunto, S. (2021). Dasar-Dasar Evaluasi Pendidikan Edisi 3. Bumi aksara.

Azmi, S., Sripatmi, Junaidi, & Wahidaturrahmi. (2024). Pengembangan Media Pembelajaran Interaktif Powerpoint Berbasis Classpoint pada Materi Matematika SMP. Mandalika Mathematics and Education Journal, 6, 384. https://doi.org/10.29303/jm.v6i1.7267

Bano, V. O., Marambaawang, D. N., & Njoeroemana, Y. (2022). Analisis Kriteria Butir Soal Ujian Sekolah Mata Pelajaran IPA di SMP Negeri 1 Waingapu. Ideas: Jurnal Pendidikan, Sosial, Dan Budaya, 8(1), 145. https://doi.org/10.32884/ideas.v8i1.660

Chau, T. H. T., & Pham, Q. V. B. (2023). EFL Learners’ Perception of Class Point Tool Application in Enhancing their Satisfaction and Active Learning in Classroom. Vietnam Journal of Education, 7(3), 302–312. https://doi.org/10.52296/vje.2023.309

Djiwandono, S. (2011). Tes Bahasa Pegangan bagi Pengajar Bahasa. PT. Indeks.

Erlina. (2022). Kaidah Penyusunan Tes Bahasa Arab (Pilihan Ganda). El Jaudah: Jurnal Pendidikan Bahasa Dan Sastra Arab, 3(2), 82–98. https://doi.org/10.56874/ej.v3i2.1075

Fatimah, L., & Alfath, K. (2019). Analisis Kesukaran Soal, Daya Pembeda, dan Fungsi Distraktor. Jurnal Komunikasi Dan Pendidikan Islam, 8(2), 1–14. https://doi.org/10.36668/jal.v8i2.115

Fitriana, N. (2023). Peningkatan Keaktifan Peserta Didik Melalui Media Persentasi Classpoint Dan Game Edukasi (Quizizz & Kahoot) Pada Pembelajaran Kimia. ACTION : Jurnal Inovasi Penelitian Tindakan Kelas Dan Sekolah, 3(1), 35–41. https://doi.org/10.51878/action.v3i1.1982

Hadi, A., Zakaria, E., & Zulkarnain, D. (2024). Interactive Learning Media Training Using the Classpoint Application to Improve the Pedagogical Competence of Madrasah Ibtidaiyah Muslimat Nahdlatul Ulama Teachers in Palangka Raya. Transformasi: Jurnal Pengabdian Masyarakat, 20(1), 28–38. https://doi.org/10.20414/transformasi.v20i1.8728

Hawamdeh, M. F., Khaled, M. M. B., Al-Barakat, A. A., & Alali, R. M. (2025). The Effectiveness of Classpoint Technology in Developing Reading Comprehension Skills among Non-Native Arabic Speakers. International Journal of Information and Education Technology, 15(1), 39–48. https://doi.org/10.18178/ijiet.2025.15.1.2216

Hazraini, Hazraini. "Upaya Meningkatkan Kompetensi Guru Kelas Dalam Penyusunan Soal Pilihan Ganda Yang Baik dan Benar Melalui Pendampingan Berbasis KKG Semester Satu Tahun Pelajaran 2017/2018 di SD Negeri 40 Cakranegara." JUPE 2.2 (2017): 111-121.

Helmawati. (2019). Pembelajaran dan Penilaian Berbasis HOTS. Remaja Rosdakarya.

Hendriawan, D., & Nurman, M. (2021). Evaluasi Pembelajaran Bahasa Arab. Sanabil.

Huang, Y.-T., Chen, M. C., & Sun, Y. S. (2018). Development and Evaluation of a Personalized Computer-aided Question Generation for English Learners to Improve Proficiency and Correct Mistakes. https://doi.org/10.48550

Istiqomah, S. (2024). Penerapan Media Presentasi ClassPoint untuk Meningkatkan Hasil Belajar Mata Pelajaran Bahasa Inggris Peserta Didik di MTsN 9 Jombang. Edu Aksara, 3(1), 1–16. https://doi.org/10.5281/zenodo.10842750

Kemdikbudristek. (2022). Capaian Pembelajaran Bahasa Arab Fase F. https://kurikulum.kemdikbud.go.id/file/cp/dasmen/34. CP Bahasa Arab.pdf

Kurniawan, T. (2015). Analisis Butir Soal Ulangan Akhir Semester Gasal Mata Pelajaran IPS Sekolah Dasar (Analysis of Odd Semester Final Test Items in Elementary School of Social Studies Subjects). Journal of Elementary Education, 4(1), 2. https://journal.unnes.ac.id/sju/index.php/jee/article/view/7488

Laili, M. (2020). Ketepatan Kontruksi Butir Pilihan Ganda Bahasa Arab. ALSUNIYAT: Jurnal Penelitian Bahasa, Sastra, Dan Budaya Arab, 3(2), 111–124. https://doi.org/10.17509/alsuniyat.v3i2.25272

Lugatoc, L. V. (2022). How ClassPoint Affects Learners in an English Class. International Journal of Innovative Science and Research Technology, 7(11), 1569–1572. https://doi.org/10.5281/zenodo.7470871

Maulana, R. (2022). Analisis Capaian Pembelajaran Bahasa Arab dengan Taksonomi Bloom Revisi. Jurnal PTK Dan Pendidikan, 8(2), 85–96. https://doi.org/10.18592/ptk.v8i2.7621

Mazlan, N. A., Tan, K. H., Othman, Z., & Wahi, W. (2023). ClassPoint Application for Enhancing Motivation in Communication among ESL Young Learners. World Journal of English Language, 13(5), 520–526. https://doi.org/10.5430/wjel.v13n5p520

Muhiddin, N., Saenab, S., Muhiddin, M., & Ilham, I. (2023). Peningkatkan Kemampuan Berpikir Kreatif Peserta Didik Kelas VIII SMPN 18 Makassar melalui Penerapan Media Interaktif ClassPoint dengan Model Discovery Learning (Studi pada Materi Sistem Ekskresi). Jurnal IPA Terpadu, 1, 634–641. https://doi.org/10.59562/semnasdies.v1i1.1139

Muhson, A. (2017). Penggunaan Anbuso (Analisis Butir Soal) versi 8.0. Universitas Negeri Yogyakarta.

Muhson, A., Lestari, B., Supriyanto, & Baroroh, K. (2015). Kelayakan Anbuso sebagai Software Analisis Butir Soal bagi Guru. Kependidikian, 45(2), 198–210. https://doi.org/10.21831/jk.v45i2.7499

Muliani, D. E., Azmi, K., Alius, M., Sulvayenti, A., & Amelia, L. (2024). The Influence of Classpoint Media on the Learning Motivation of Physics Education Study Program Students. Kasuari: Physics Education Journal (KPEJ), 7(1), 13–22. https://doi.org/10.37891/kpej.v7i1.484

Munip, A. (2017). Penilaian Pembelajaran Bahasa Arab. Fakultas Ilmu Tarbiyah dan Keguruan UIN Sunan Kalijaga Yogyakarta.

Nugraheni, A. (2024). Trasformasi Media Artificial Intelegensi (AI) dengan Classpoint sebagai Aplikasi Pembelajaran Futuristik di Era Digital. 8(1), 1–10. http://dx.doi.org/10.53746/perspektif.v17i1.171

Nurjanah, & Marlianingsih, N. (2015). Analisis Butir Soal Pilihan Ganda Dari Aspek Kebahasaan. Faktor Jurnal Ilmu Kependidikan, II(1), 69–78. https://doi.org/10.30998/fjik.v2i1.377

Oktadela, R., Hadiyanti, P., & Elida, Y. (2024). The Implementation of Classpoint in Learning English: A Case Study. Journal of English Language and Education, 9(3), 2024. https://doi.org/https://doi.org/10.31004/jele.v9i3.516

Pujiati. (2024). Cara Membuat Prompt AI agar Hasil Optimal. Dunia Dosen. https://duniadosen.com/cara-membuat-prompt-ai/

Ramadhani, F. S., & Unsiah, F. (2024). How Do EFL Students Across Gender Perceive Classpoint toward Their Motivation in Learning English? ETERNAL (English Teaching Journal), 15(1), 69–82. https://doi.org/10.26877/eternal.v15i1.338

Sanusi, R. N. A., & Aziez, F. (2021). Analisis Butir Soal Tes Objektif dan Subjektif untuk Keterampilan Membaca Pemahaman pada Kelas VII SMP N 3 Kalibagor. Metafora: Jurnal Pembelajaran Bahasa Dan Sastra, 8(1), 99. https://doi.org/10.30595/mtf.v8i1.8501

Sappaile, B. I. (2010). Konsep Penelitian Ex-Post Facto. Jurnal Pendidikan Matematika, 1(2), 105–113.

Sari, D., & Pratiwi, V. (2023). Pengembangan Instrumen Asesmen Berbasis HOTS (Higher Order Thinking Skill) Berbantuan Aplikasi Classpoint Pada Mata Pelajaran Layanan Lembaga Keuangan Syariah. Jurnal Pendidikan Dan Kebudayaan (JURDIKBUD), 3(2), 285–304. https://doi.org/10.55606/jurdikbud.v3i2.1915

Serdianus, S., & Saputra, T. (2023). Peran Artificial Intelligence Chatgpt dalam Perencanaan Pembelajaran di Era Revolusi Industri 4.0. Masokan: Ilmu Sosial Dan Pendidikan, 3(1), 1–18. https://doi.org/10.34307/misp.v3i1.100

Setiyanto, S. (2023). Pandangan Mahasiswa Dalam Penggunaan Media Pembelajaran Interaktif Pada Mata Kuliah Dokumentasi Kebidananmenggunakan Classpoint. Journal of Innovation And Future Technology (IFTECH), 5(1), 69–78. https://doi.org/10.47080/iftech.v5i1.2463

Setiyawan, A. (2014). Faktor- faktor yang Mempengaruhi Reliabilitas Tes. Jurnal An Nûr, VI(2), 341–354.

Sukiman. (2012). Pengembangan Sistem Evaluasi. Insan Madani.

Sumaningsih, S. (2015). Kualitas Butir Soal UAS Bahasa Inggris Untuk Siswa Mts di Samarinda. LINGUA: Jurnal Bahasa, Sastra, Dan Pengajarannya, 12(2), 223–232.

Susetyo, B. (2015). Prosedur Penyusunan dan Analisis Tes untuk Penilaian Hasil Belajar Bidang Kognitif. Refika Aditama.

Syafiudin. (2020). Validitas dan Reliabilitas Instrumen Penilaian pada Mata Pelajaran Bahasa Arab. Jurnal Kajian Perbatasan Antarnegara, Diplomasi Dan Hubungan Internasional, 3(2), 106–118.

Syihabuddin, S. (2018). Tes dan Evaluasi Pengajaran Bahasa. UPI Press.

Uno, H., & Koni, S. (2018). Assessment Pembelajaran. Bumi Aksara.

Wao, Y. P., Priska, M., & Peni, N. (2022). Persepsi Mahasiswa Terhadap Penggunaan Media Pembelajaran Interaktif Classpoint Pada Mata Kuliah Zoologi Invertebrata. Jurnal Inovasi Pembelajaran Biologi, 3(2), 76–87. https://doi.org/10.26740/jipb.v3n2.p76-87

Widodo, S., Ladyani, F., Asrianto, L. O., Rusdi, Khairunnisa, Lestari, S. M. P., Devrianya, A., Wijayanti, D. R., Hidayat, A., Dalfian, Nurcahyati, S., Sjahriani, T., Armi, Widya, N., & Rogayah. (2023). Metodologi Penelitian. CV Science Techno Direct.

Wise, S., & Kuhfeld, M. (2019). What Happens When Test Takers Disengage? Understanding and Addressing Rapid Guessing (The Collaborative for Student Growth at NWEA Research Brief). https://www.nwea.org/uploads/2020/03/researchbrief-what-happens-when-test-takers-disengage-understanding-and-addressing-rapid-guessing-2019.pdf

Zuhri, N., Sopian, A., Sauri, S., & Nurbayan, Y. (2024). Analisis Validitas dan Reliabilitas Soal Bahasa Arab melalui Website OpExams Pembuat Soal Berbasis AI. Jurnal Pendidikan Modern, 9(2), 87–91. https://doi.org/10.37471/jpm.v9i2.863

Zuhri, N. Z., Syihabuddin, S., & Tatang, T. (2024). Analisis Validitas, Reliabilitas, dan Tingkat Kesukaran Soal Bahasa Arab Tingkat SMP Berbasis Artificial Intelligence (AI) melalui Platform QuestionWell. Jurnal Pendidikan Dan Pembelajaran Indonesia (JPPI), 4(2), 693–704. https://doi.org/10.53299/jppi.v4i2.576.