Assessing materials development: An expert evaluation of instructional materials developed by pre-service English teachers
DOI:
https://doi.org/10.12928/eltej.v9i1.14997Keywords:
Pre-service English teachers, Instructional design proficiency, Higher-order thinking skills, Pedagogical principles, Materials constructionAbstract
The ability of pre-service English teachers to create high-quality, contextually appropriate instructional materials is a critical component of effective pedagogy. This study provides a quantitative and analytical assessment of their proficiency in instructional design. By evaluating 28 material packages developed by pre-service teachers, this study identifies their strengths and remaining challenges in implementing modern pedagogical principles. A panel of ten subject experts evaluated the materials using a validated rubric assessing curriculum alignment, relevance, higher-order thinking skills (HOTS), and 21st-century skills. The results revealed variation in design competencies, with pre-service teachers performing best in foundational areas such as curriculum alignment (mean score 7.875) and pedagogy (mean scores for Suitability and 21st-century skills were 7.679 and 7.357, respectively). However, the study also found challenges in applying advanced pedagogical concepts, such as HOTS, Industry 4.0, and Society 5.0, with mean scores of 7.000, 7.000, and 6.964, respectively. These findings suggest an area for further strengthening in teacher education programs, particularly in supporting the integration of complex, abstract concepts like HOTS and contemporary pedagogical frameworks. Without sufficient preparation in these areas, pre-service teachers may find it challenging to apply these concepts effectively in their instructional practice.
References
Adipat, S. (2021). Developing Technological Pedagogical Content Knowledge (TPACK) through Technology-Enhanced Content and Language-Integrated Learning (T-CLIL) Instruction. Education and Information Technologies, 26(5), 6461–6477. https://doi.org/10.1007/s10639-021-10648-3
Amalia, T., Inayati, D., & Marini, A. (2023). Improving students’ motivation in learning English through gamification. Jurnal Pendidikan Bahasa Inggris Undiksha, 11(1), 1–9. https://doi.org/10.23887/jpbi.v11i1.63332
Ann L. Jaca, C., & D. Castañeda Jr., W. (2025). Graduate competencies as predictors of the pre-service English teachers’ work-readiness. International Journal of Evaluation and Research in Education (IJERE), 14(4), 3211. https://doi.org/10.11591/ijere.v14i4.32609
Azhra, S. Y., Carabella, P. A., Eiden, K., Payung, N. F., Sukarno, S., Pratiwi, D., & Gharamah, F. M. A. (2024). Improving junior high school students’ vocabulary understanding by using quiz-based application. Diksi, 32(2), 247–266. https://doi.org/10.21831/diksi.v32i2.69225
Basikin, B. (2024). The Contribution of Inservice Teacher Education Program (PPG) on teachers’ professionalism. English Language Teaching Educational Journal, 6(2), 124–136. https://doi.org/10.12928/eltej.v6i2.10076
Bueno, R., Niess, M. L., Aldemir Engin, R., Ballejo, C. C., & Lieban, D. (2023). Technological pedagogical content knowledge: Exploring new perspectives. Australasian Journal of Educational Technology, 88–105. https://doi.org/10.14742/ajet.7970
Bulqiyah, S., & Munir, A. (2023). Revealing EFL teachers’ experiences in the integration of web-based assessment media for assessment. Journal of English Teaching and Learning Issues, 6(1), 45. https://doi.org/10.21043/jetli.v6i1.19624
Creswell, J. W. (2017). Qualitative inquiry and research design (international student edition). Choosing among five approaches. SAGE Publications.
Das, K., & Mittra, S. (2021). Scope of introducing TPACK of teacher education programme in India. Shanlax International Journal of Arts, Science and Humanities, 8(4), 31–38. https://doi.org/10.34293/sijash.v8i4.3805
Drajati, N. A., Rakerda, H., Sulistyawati, H., Nurkamto, J., & Ilmi, M. (2021). Investigating the adoption of TPACK-21cl by English pre-service teachers in a Covid-19 teaching practicum. Indonesian Journal of Applied Linguistics, 11(1). https://doi.org/10.17509/ijal.v11i1.34625
Erfan, F., Sulisyaningsih, S., & Syakur, Abd. (2022). Integration of ICT-pedagogy for senior high school students: Pre-service teachers’ TPACK (Technological Pedagogical Content Knowledge). Budapest International Research and Critics Institute (BIRCI-Journal). https://doi.org/10.33258/birci.v5i1.4236
Esteban, A. J., & Sung, K. (2025). Influence of playing online video games on Filipino college students’ confidence in speaking English. International Journal of Evaluation and Research in Education (IJERE), 14(4), 2555. https://doi.org/10.11591/ijere.v14i4.32842
Febriyanti, E. R. (2018). Identifikasi analisis kebutuhan pembelajar bahasa Inggris (non Program Studi Bahasa Inggris) pada mata kuliah bahasa Inggris ESP di lingkungan FKIP Universitas Lambung Mangkurat Banjarmasin. Vidya Karya, 32(2), 123. https://doi.org/10.20527/jvk.v32i2.5230
Garba, S. A., Ranjit Singh, T. K., & Yusuf, N. M. (2013). Integrating technology in teacher education curriculum and pedagogical practices: The effects of web-based technology resources on pre-service teachers’ achievement in teacher education training. Proceedings of the 2013 International Conference on Information Science and Technology Applications. https://doi.org/10.2991/icista.2013.14
Gorozhankina, T. N., & Grechukhina, V. V. (2022). Authentic video materials as a means of shaping communicative competence in Russian among Spanish and Dutch learners. Russian Language Studies, 20(4), 483–499. https://doi.org/10.22363/2618-8163-2022-20-4-483-499
Greene, M., Cheng, S.-L., & Jones, M. (2023). Preservice teachers’ technology integration knowledge development in an online technology-based course. International Journal of Instruction, 16(4), 385–404. https://doi.org/10.29333/iji.2023.16423a
Grewal, S., Manuel, M., & Veettil, R. P. (2024). Principles and procedures of material development in the evolving ELT scenario. Salud, Ciencia y Tecnología - Serie de Conferencias, 3, 656. https://doi.org/10.56294/sctconf2024656
Haerazi, H. (2023). English pre-service teachers’ responses to writing online instruction and critical teacher feedback. Pedagogy: Journal of English Language Teaching, 11(2), 141. https://doi.org/10.32332/joelt.v11i2.7388
Hamzah, I. (2023). The effect of Quizizz on students reading comprehension. Journal of Arts and Education, 3(1). https://doi.org/10.33365/jae.v3i1.208
Handayani, S., Hussin, M., & Norman, H. (2024). Evaluating teaching readiness using the TPACK model: Factor, reliability, and validity analyses for Indonesian Economics teacher candidates. Perspectives of Science and Education, 68(2), 679–698. https://doi.org/10.32744/pse.2024.2.41
Hoir, S., Subandowo, M., & Wiyarno, Y. (2019). Improve your English through the 21st century skill. Edcomtech Jurnal Kajian Teknologi Pendidikan, 4(1), 38–48. https://doi.org/10.17977/um039v4i12019p038
Husnah, L. Al, Heriyawati, D. F., & Elfiyanto, S. (2023). Quizizz paper mode is new: Students’ perception of using E-Tool of language assessment in EFL class. Celtic: A Journal of Culture, English Language Teaching, Literature and Linguistics, 10(2), 121–137. https://doi.org/10.22219/celtic.v10i2.28528
Joshi, S. (2023). TPACK and teachers’ self-efficacy: A systematic review. Canadian Journal of Learning and Technology, 49(2), 1–23. https://doi.org/10.21432/cjlt28280
Julita, R. (2024). The impact of gamification on EFL students’ reading comprehension. Journal of English as a Foreign Language Education (JEFLE), 4(2), 136. https://doi.org/10.26418/jefle.v4i2.74901
Kao, Y. (2023). Empowering preservice English teachers with language assessment literacy concepts and practices: Application of Vygotskian concept‐based language instruction. The Modern Language Journal, 107(S1), 68–94. https://doi.org/10.1111/modl.12818
Kapoyannis, T. (2021). The Name Jar Project: Supporting preservice teachers in working with English language learners. Language and Literacy, 23(3), 45–65. https://doi.org/10.20360/langandlit29510
Laabidi, Y. L. Y. (2021). Influence of teaching experience on teachers’ level of use of critical thinking. LLT Journal: A Journal on Language and Language Teaching, 24(2), 514–528. https://doi.org/10.24071/llt.v24i2.3719
Legesse, B., Legesse, D., & Demissie, M. (2024). Examining the mediating role of college-based capacities on the relationship between technology integration and teacher preparation program implementation quality in the Southern Nation, nationalities and peoples’ region, Ethiopia. https://doi.org/10.21203/rs.3.rs-4973025/v1
Limbong, E., Setiawan, I., & Hamilton, A. (2024). Bridging the gap: The reality of digital technology integration by Indonesian pre-service EFL teachers. Script Journal: Journal of Linguistics and English Teaching, 9(1), 58–78. https://doi.org/10.24903/sj.v9i1.1524
Liu, P.-L., Chen, C.-J., & Huang, C.-Y. (2025). Evaluating the effectiveness of Quizizz for enhancing English vocabulary acquisition and engagement among rural elementary students. Sage Open, 15(4). https://doi.org/10.1177/21582440251379697
Maming, K., Sani, A. A., Putra, D. P., & Radiana, S. P. (2023). Get ahead with Quizizz: Advancing junior high school students’ vocabulary mastery in online learning. Elsya : Journal of English Language Studies, 5(2), 224–235. https://doi.org/10.31849/elsya.v5i2.10275
Manipatruni, V. R., Kumar, N. S., Karim, M. R., & Banu, S. (2023). Improving English vocabulary through Quizizz in practice tests for gamification and Google Forms with AutoProctor in assessment tests for the preclusion of malpractice. International Journal of Interactive Mobile Technologies (IJIM), 17(13), 22–43. https://doi.org/10.3991/ijim.v17i13.39445
Mat, H., Nusantara, T., Atmoko, A., Hanafi, Y., & Mustakim, S. S. (2025). Need analysis: development of a teaching module for enhancing higher-order thinking skills of primary school students. International Journal of Evaluation and Research in Education (IJERE), 14(3), 1643. https://doi.org/10.11591/ijere.v14i3.30335
Mukundan, J., Hajimohammadi, R., & Nimehchisalem, V. (2011). Developing an English language textbook evaluation checklist. Contemporary Issues in Education Research (CIER), 4(6), 21. https://doi.org/10.19030/cier.v4i6.4383
Namestovski, Ž., & Kovari, A. (2022). Framework for preparation of engaging online educational materials, a cognitive approach. Applied Sciences, 12(3), 1745. https://doi.org/10.3390/app12031745
Nugraheni, R., & Fakhurriana, R. (2023). Boosting English vocabulary proficiency in EFL learners: A study on the efficacy of Quizizz at IAIN Kediri. Indonesian Journal of Multidisciplinary Educational Research, 1(2), 161–177. https://doi.org/10.30762/ijomer.v1i2.1379
Obasi, J. C. (2022). “What I see, I understand”: Attitudes of selected university undergraduates towards the utilization of authentic materials in teaching in an ESL classroom. Nsukka Journal of the Humanities, 30(1), 21–31. https://doi.org/10.62250/nsuk.2022.30.1.21-31
Ölçer-Çevik, S., & Kozaner, Ç. (2025). Building a sustainable future: perspectives on primary school sustainability projects from teachers and pre-service teachers. International Journal of Evaluation and Research in Education (IJERE), 14(5), 3403. https://doi.org/10.11591/ijere.v14i5.33362
Olori, A., & Saka, A. O. (2024). Differences in Technological Pedagogical Content Knowledge between experienced and less experienced computer teachers in Ogun State, Nigeria. IIUM Journal of Educational Studies, 12(2), 21–32. https://doi.org/10.31436/ijes.v12i2.514
Permana, P., Permatawati, I., & Khoerudin, E. (2023). Foreign language learning gamification using Quizizz: A systematic review based on students’ perception. Eralingua: Jurnal Pendidikan Bahasa Asing dan Sastra, 7(2), 233. https://doi.org/10.26858/eralingua.v7i2.23969
Pratolo, B. W., Anwari, H., Purwanti, E., Fatimah, N., Soviyah, S., & Nuryana, Z. (2026). Revolution or ruin? Systematic insights into the redefinition of the teacher book. English Language Teaching Educational Journal, 8(3), 249–270. https://doi.org/10.12928/eltej.v8i3.15138
Pratiwi, D. I., & Waluyo, B. (2022). Integrating task- and game-based learning into an online TOEFL preparation course during the COVID-19 outbreak. Malaysian Journal of Learning and Instruction, 19. https://doi.org/10.32890/mjli2022.19.2.2
Ridwan, A., & Athena, T. (2023). Professional development altogether: Pre-service and in-service EFL teacher collaboration in doing classroom action research. Elsya : Journal of English Language Studies, 5(2), 147–158. https://doi.org/10.31849/elsya.v5i2.11929
Setiyowati, E., Puspita, A. M. I., & Mariana, N. (2025). Teachers’ pedagogical competence in designing Deep Learning and HOTS assessment in elementary schools. Journal of Innovation and Research in Primary Education, 4(4), 4011–4029. https://doi.org/10.56916/jirpe.v4i4.2633
Setyaningrum, A., & Putri, D. (2023). Pre-service English teachers’ voices toward the use of Quizizz in learning tourism. Pedagogy: Journal of English Language Teaching, 11(2), 163. https://doi.org/10.32332/joelt.v11i2.7629
Stofflett, R. T., & Stoddart, T. (1994). The ability to understand and use conceptual change pedagogy as a function of prior content learning experience. Journal of Research in Science Teaching, 31(1), 31–51. https://doi.org/10.1002/tea.3660310105
Sukarno, S. (2024). SQRAR: A model of coursebook evaluation. English Language Teaching Educational Journal, 7(1), 13–23. https://doi.org/10.12928/eltej.v7i1.10306
Sumarni, S., Ifan Iskandar, & Imam Santosa. (2023). Assessing digital competence among pre-service English language teachers: Strengths and weaknesses. Journal of English Education and Teaching, 7(3), 613–631. https://doi.org/10.33369/jeet.7.3.613-631
Thohir, M. A., Sukarelawan, Moh. I., Jumadi, J., Warsono, W., & Citrasukmawati, A. (2021). The effects of an instructional design-based web course on pre-service teachers’ competencies. International Journal of Evaluation and Research in Education (IJERE), 10(1), 230. https://doi.org/10.11591/ijere.v10i1.20475
Tortorelli, L. S., Lupo, S. M., & Wheatley, B. C. (2021). Examining teacher preparation for code‐related reading instruction: An integrated literature review. Reading Research Quarterly, 56(S1). https://doi.org/10.1002/rrq.396
Waluyo, B., Phanrangsee, S., & Whanchit, W. (2023). Gamified grammar learning in online English courses in Thai higher education. Online Journal of Communication and Media Technologies, 13(4), e202354. https://doi.org/10.30935/ojcmt/13752
Zein, S., Sukyadi, D., Hamied, F. A., & Lengkanawati, N. S. (2020). English language education in Indonesia: A review of research (2011–2019). Language Teaching, 53(4), 491–523. https://doi.org/10.1017/S0261444820000208
Zhang, H., Wang, Z., Jiang, R., & Wu, H. (2025). Exploring the influence of technology-enhanced active learning environments on pre-service teachers’ TPACK and technology beliefs. Sage Open, 15(3). https://doi.org/10.1177/21582440251359823
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Sukarno, Sari Hidayati, Ihtiara Fitrianingsih, Dewi Nur Widiyati , Shabrina Yumna Azhra , Megan Jinabe , Fitriya Dessi Wulandari , Herwin Dyastuti, Kauna Karima , Adivta Yudha Tama , Nita Maghfiratul Jannah , Fadhl Mohammed Awadh Gharamah, Yasir A. Alsamiri
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish in ELTEJ agree to the following terms: Authors retain copyright and grant the ELTEJ right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share (copy and redistribute the material in any medium or format) and adapt (remix, transform, and build upon the material) the work for any purpose, even commercially with an acknowledgement of the work's authorship and initial publication in ELTEJ. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in ELTEJ. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
