SQRAR: A model of coursebook evaluation
DOI:
https://doi.org/10.12928/eltej.v7i1.10306Keywords:
English, coursebook, dynamic evaluation, SQRARAbstract
Coursebooks have become the most prominent English learning materials, especially in formal education. Therefore, recursive evaluation should be conducted to adjust the coursebook based on the current needs and learning goals. Moreover, dynamic evaluation brings interaction or mediation with a genuine act of teaching to make the evaluation more meaningful and substantial. However, limited resources are available, especially the ones that could help the teacher evaluate vivid steps dynamically. This study fulfills the need for a coursebook, especially ELT, evaluation method by following the research and development design proposed initially by Dick and Carey that many experts have simplified. The design was constructed from a sequence of steps, namely ADDIE (Analysis, Design, Development, Implementation, and Evaluation). Thirty participants conducted an evaluation phase based on the product trial design, followed by a Focus Group Discussion (FGD). The data were gathered using a questionnaire and the interview guidelines. The instruments were developed based on the ideal coursebook criteria. They are shaped in quantitative and qualitative forms and analyzed using Creswell’s data analysis technique. Thus, a set of evaluation methods was designed: SQRAR (Survey, Question, Read, Analyse, and Recommend). The design benefits the teachers by allowing them to evaluate the coursebook systematically and effectively. Survey results demonstrate strong consensus among English teachers, advocating for urgent development of such evaluation models. Implementation of the SQRAR model involves detailed stages emphasizing thorough evaluation and constructive feedback, with micro and macro evaluation options discussed. The model ensures comprehensive evaluation, consistency, and alignment with learning objectives and provides clear recommendations for coursebook improvement.
References
Afifah, W. A. (2019). Developing Culture-Based English Instructional Materials for Grade VII of Junior High School Students. English Language Teaching Educational Journal, 1(2), 76. https://doi.org/10.12928/eltej.v1i2.390
Agustina, N. Q., & Mukhtaruddin, F. (2019). The Cipp Model-Based Evaluation on Integrated English Learning (IEL) Program at Language Center. English Language Teaching Educational Journal, 2(1), 22. https://doi.org/10.12928/eltej.v2i1.1043
Alkhaldi, A. A. (2010). Developing a Principled Framework for Materials Evaluation: Some Considerations. Advances in Language and Literary Studies, 1(2), 281–298. https://doi.org/10.7575/aiac.alls.v.1n.2p.281
Alsagoff, L., Lee Mckay, S., Hu, G., & Renandya, W. A. (Eds.). (2012). Principles and Practices for Teaching English as an International Language. Routledge. https://doi.org/10.4324/9780203819159
Ansary, H., & Babaii, E. (2002). Universal characteristics of EFL/ESL textbooks: A step towards systematic textbook evaluation. The Internet TESL Journal, 8.
Azarnoosh, M., Zeraatpishe, M., Faravani, A., & Kargozari, R. (2018). Issues in Coursebook Evaluation. Brill Sense. https://doi.org/10.1163/9789004387379
Banegas, D. L., & Tavella, G. (2021). Language-Driven CLIL in Primary Education: An Analysis of General English Coursebooks in Argentina (pp. 239–258). https://doi.org/10.1007/978-3-030-70095-9_12
Branch, R. M. (2009). Instructional Design: The ADDIE Approach. Springer. https://doi.org/10.1007/978-0-387-09506-6
Buku yang Digunakan oleh Satuan Pendidikan, Pub. L. No. 8 (2016).
Cheng, L., & Zhao, Y. (2020). Dynamic evaluation of coursebooks: An empirical study of Chinese college English teachers’ perceptions. Journal of English for Academic Purposes, 47(10), 08–78.
Dahmardeh, M., & Kim, S.-D. (2021). An analysis of the representation of cultural content in English coursebooks. Journal of Applied Research in Higher Education. https://doi.org/10.1108/JARHE-09-2020-0290
Dimitropoulos, E. (1999). Educational Evaluation: The evaluation of education and the educational project. Grigoris.
Dorda, S. (2008). The role of materials in teaching ESP. Sumy State University.
Ellis, R. (1997). The empirical evaluation of language teaching materials. ELT Journal, 51(1), 36–42. https://doi.org/10.1093/elt/51.1.36
Ellis, R. (2003). The study of second language acquisition. Oxford University Press.
Graves, K. (2003). Coursebook. In D. Nunan (Ed.), Practical English language teaching (pp. 225–246). Contemporary.
Haywood, H. C., & Lidz, C. S. (2007). Dynamic Assessment in Practice: Clinical and Educational Applications. Cambridge University Press. https://doi.org/10.1017/CBO9780511607516
Joshi, A., Kale, S., Chandel, S., & Pal, D. (2015). Likert Scale: Explored and Explained. British Journal of Applied Science & Technology, 7(4), 396–403. https://doi.org/10.9734/BJAST/2015/14975
Maley, A. (2016). Principles and procedures in materials development. In M. Azarnoosh, M. Zeraatpishe, A. Faravani, & H. R. Kargozari (Eds.), Issues in materials development (pp. 11–30). Sense Publishers. https://doi.org/10.1007/978-94-6300-432-9_2
McGriff, S. J. (2000). Instructional System Design (ISD): Using the ADDIE Model. Penn State University.
Milal, A. D., Rohmah, Z., & Kusumajanti, W. (2020). Varying strategies to maximize the effectiveness of ELT: Lessons from training sessions. English Language Teaching Educational Journal, 3(3), 263–271. https://doi.org/10.12928/eltej.v3i3.2463
Mishan, F. (2022). The Global ELT coursebook: A case of Cinderella’s slipper? Language Teaching, 55(4), 490–505. https://doi.org/10.1017/S0261444820000646
Molenda, M. (2003). In Search of the Elusive ADDIE model. Performance Improvement, 42(5), 34–36. https://doi.org/10.1002/pfi.4930420508
Molenda, M., & Boling, E. (2008). Creating. In Educational Technology: A definition with commentary (pp. 81–140). Routledge.
Muhammad, K. S. (2016). How To Choose Suitable English Coursebooks To Be Used In The English Teaching-Learning Process: Doing A Micro Evaluation. Journal of English and Education, 2(1), 92–107. https://doi.org/10.20885/jee.vol2.iss1.art8
Mukundan, J., & Ahour, T. (2010). A Review of Textbook Evaluation Checklists across Four Decades (1970-2008). In B. Tomlinson & H. Masuhara (Eds.), Research for Materials Development (pp. 336–352). Continuum.
Nurdiana, & Junita. (2020). Adapted criteria and a model of evaluation checklist for English coursebooks. Journal of Language, Literature and Teaching, 2(2), 1–16.
Peterson, C. (2003). Bringing ADDIE to Life: Instructional Design at Its Best. Journal of Educational Multimedia and Hypermedia, 12(3), 227–241.
Poehner, M. . (2008). Dynamic assessment: A vygotskian approach to understanding and promoting l2 development. In Educational Linguistics, 9, 1–197.
Purwanti, E., & Hatmanto, E. D. (2019). nderstanding EFL teachers’ beliefs about lesson study and their knowledge development viewed from social cultural theory of Vygotsky. English Language Teaching Educational Journal, 2(2), 50–61.
Renandya, W. A., Hu, W., & Xiang, Y. (2015). Extensive Reading Coursebook in China. RELC Journal, 46(3), 255–273. https://doi.org/10.1177/0033688215609216
Richards, J. C., & Renandya, W. A. (2002). Methodology in language teaching: an anthology of current practice. Cambridge University Press. https://doi.org/10.1017/CBO9780511667190
Rojabi, A. R. (2020). Exploring EFL Students’ Perception of Online Learning via Microsoft Teams: University Level in Indonesia. English Language Teaching Educational Journal, 3(2), 163. https://doi.org/10.12928/eltej.v3i2.2349
Rybicki, A. (2002). Developing effective study skills while studying a foreign language. Saint Xavier University and SkyLight.
Saputri, N. N. A., El Khoiri, N., & Muniroh, S. (2022). Exploring the Manifestation of Critical Thinking in a Coursebook for Advanced Reading Class. JoLLA: Journal of Language, Literature, and Arts, 2(7), 944–957. https://doi.org/10.17977/um064v2i72022p944-957
Sato, M. (2013). Beliefs about peer interaction and peer corrective feedback: Efficacy of classroom intervention. The Modern Language Journal, 97(3), 611–633. https://doi.org/10.1111/j.1540-4781.2013.12035.x
Savova, L., & Azarnoosh, M. (2022). Approaches to Coursebook Evaluation: Dynamic Approach to Coursebook Evaluation in Context. In H. Çelik & S. Çelik (Eds.), Coursebook Evaluation in English as a Foreign Language (EFL) Education (pp. 47–64). Vizetek.
Setiawan, W. (2023). Evaluation of English coursebook Challenges 1 from the perspectives of teachers. Wiralodra English Journal, 7(2), 78–88. https://doi.org/10.31943/wej.v7i2.232
Shave, J. (2010). A Friendly Process for Evaluating and Selecting ESL/ EFL Coursebooks. The Internet TESL Journal, 16(11).
Shi, J. (2014). Criteria for teaching learning resource selection: Facilitating teachers of Chinese to work with English-speaking learners. University of Western Sydney.
Skierso, A. (1991). Textbook selection and evaluation. In M. Celce-Murcia (Ed.), Teaching English as a Second or Foreign Language (2nd ed., pp. 432–453). Heinle & Heinle Publishers.
Solhi, M., Sak, M., Şahin, Ş., & Yilmaz, S. (2020). Evaluation of the English language coursebooks used at the Turkish public elementary schools. Journal of Language and Linguistics Studies, 16(3), 1282–1308. https://doi.org/10.17263/jlls.803714
Soviyah, & Fatimah, N. (2021). Developing material for English for Holiday program. English Language Teaching Educational Journal, 4(3), 235–250. https://doi.org/10.12928/eltej.v4i3.5000
Standar Isi Pendidikan Dasar dan Menengah, Pub. L. No. 21 (2016).
Sternberg, R. J., & Grigorenko, E. L. (2002). Dynamic Testing: The Nature and Measurement of Learning Potential. Cambridge University Press.
Sucipto, S., & Cahyo, S. D. (2019). A Content Analysis of the Reading Activities in “Bright 2”an English Textbook for Junior High School Students. English Language Teaching Educational Journal, 2(1), 13. https://doi.org/10.12928/eltej.v2i1.918
Supriyanto, N. H. (2019). An evaluation of English coursebook for young learners entitled English Chest. Magister Scientiae, 46, 145–182. https://doi.org/10.33508/mgs.v2i46.2225
Surono, P. B. W., & Hanun, L. S. (2022). Analysis of HOTS and LOTS of instructional questions in the English textbook “When English Rings a Bell” for grade VIII. English Language Teaching Educational Journal, 5(3), 240–252. https://doi.org/https://doi.org/10.12928/eltej.v5i3.8168
Surono, Pratolo, B. W., & Hanun, S. L. (2022). Analysis of HOTS and LOTS of instructional questions in the English textbook" When English Rings a Bell" for grade VIII. English Language Teaching …, 5(3), 240–252. http://www.journal2.uad.ac.id/index.php/eltej/article/view/8168%0Ahttp://www.journal2.uad.ac.id/index.php/eltej/article/download/8168/3711
Tsiplakides, I. (2011). Selecting an English Coursebook: Theory and Practice. Theory and Practice in Language Studies, 1(7). https://doi.org/10.4304/tpls.1.7.758-764
United Nations Development Programme. (2002). Handbook on Monitoring and Evaluating for Results. Evaluation Office.
Vedung, E. (2017). Public Policy and Program Evaluation. Routledge. https://doi.org/10.4324/9781315127767
Yilmaz, Y. E., & Tugrul, M. (2017). A dynamic coursebook evaluation approach for an EAP program. Journal of Language and Linguistic Studies, 13(1), 22–41.
Zohrabi, M., Sabouri, H., & Behroozian, R. (2012). An Assessment of Strengths and Weaknesses of Iranian First Year High School English Coursebook Using Evaluation Checklist. English Language and Literature Studies, 2(2). https://doi.org/10.5539/ells.v2n2p89
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Sukarno Sukarno
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish in ELTEJ agree to the following terms: Authors retain copyright and grant the ELTEJ right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share (copy and redistribute the material in any medium or format) and adapt (remix, transform, and build upon the material) the work for any purpose, even commercially with an acknowledgement of the work's authorship and initial publication in ELTEJ. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in ELTEJ. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
