The quality of an English summative test of a public junior high school, Kupang-NTT
DOI:
https://doi.org/10.12928/eltej.v3i2.2311Keywords:
English summative test, validity, reliability, item analysisAbstract
This study aimed at examining the quality of an English summative test of grade VII in a public school located in Kupang. Particularly, this study examined content validity, reliability, and conducted item analysis including item validity, item difficulty, item discrimination, and distracter effectiveness. This study was descriptive evaluative research with documentation to collect data. The data was analyzed quantitatively except for content validity, which was done qualitatively. Content validity was analyzed by matching the test items with materials stated in the curriculum. The findings revealed that the English summative test had a high content validity. The reliability was estimated by applying the Kuder-Richardson’s formula (K-R20). The result showed that the test was reliable and very good for a classroom test. The item analysis was conducted by using ITEMAN 3.0. and it revealed that the the test was mostly constructed by easy items, most of the items could discriminate the students, most distracters were able to perform well, and the most of items were valid.References
Abedi, J. (2009). Validity of assessments for English language learning students in a national/international context. ESE, 16, 167-183. https://www.semanticscholar.org/paper/Validity-of-assessments-for-English-Language-in-a-Abedi/0351. Accesed 24 July 2020.
Arikunto, S. (2013). Dasar-dasar evaluasi pendidikan (2nd ed.). Jakarta: Paragonatama Jaya.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Designing and developing useful language tests. Oxford, New York: Oxford University Press.
Brown, H. D. (2004). Language assessment. Principles and classroom practices. White Plains, NY: Pearson Education, Inc.
Chang, C.-C., & Wu, B.-H. (2012). Is teacher assessment reliable or valid for high school students under a web-based portfolio environment? Educational Technology & Society, 15(4), 265–278. https://www.ds.unipi.gr/et&s/journals/15_4/23.pdf. Accesed 24 July 2020.
DiBattista, D., & Kurzawa, L. (2011). Examination of the quality of multiple-choice items on classroom tests. The Canadian Journal for the Scholarship of Teaching and Learning, 2(2). https://doi.org/10.5206/cjsotl-rcacea.2011.2.4
Djiwandono, S. (2011). Tes bahasa. Pengangan bagi pengajar bahasa (2nd ed.). Jakarta: PT. Indeks Jakarta.
Fathoni. (2017). An analysis on content validity of English summative test items of second grade students at MTsN Kalijambe in the academic year 2015/2016. State Islamic Institute of Surakarta.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. https://doi.org/1080/15434303.2011.642041
Furwana, D. (2019). Validity and reliability of teacher-made English summative test at second grade of vocational high school 2 Palopo. Journal of Language and Literature, 13(2), 113-122. https://doi.org/10.15294/lc.v13i2.18967
Griswold, P. A. (1990). Assessing relevance and reliability to improve the quality of teacher-made tests. NASSP Bulletin, 76, 18-24. https://doi.org/10.1177/019263659007452305
Haryudin, A. (2015). Validity and reliability of English summative tests at junior high school in West Bandung. Jurnal Ilmiah P2P STKIP Siliwangi, 2(1), 77-90. https://doi.org/10.22460/p2m.v2i1p77-90.167
Hughes, A. (1989). Testing for language teachers. Cambridge: Cambridge University Press.
Husna, H. H. (2012). An analysis of English summative test for 6th grade students in three public elementary schools in Udanawu District, Blitar Regency. State University of Malang.
Iliya, A. (2014). Formative and summative assessment in educational enterprise. Journal of Education and Practice, 5(20), 111-117. https://www.iiste.org/Journals/index.php/JEP/article/view/14252. Accessed 24 July 2020.
Mindes, G. (2003). Assessing young children (2nd ed.). New Jersey: Pearson Education, Inc.
Munoz, A., Alvarez, M., Casals, S., Gaviria S., & Palacio, M. (2003). Validation of an oral assessment tool for classroom use. Columbian Applied Linguistics Journal, 5(5), 139-157. https://doi.org/10.14483/22487085.186
Nugrahanto, A., Winarsih, D., & Farikah. (2018). The content validity of the summative test items of English for the tenth graders of SMA Negeri 1 Magelang in the school year 2015/2016. Journal of Research on Applied Linguistics Language and Language Teaching, 1(1), 7-14. https://doi.org/10.31002/jrlt.v1i1.188
Nunnally, J. (1978). Psychometric theory. New York: McGrow-Hill Contemporary.
Primadani, A. E. (2013). An analysis of a midterm English test of the 7th grade accelerated class at SMPN 3 Malang. State University of Malang.
Qu, W., & Zhang, C. (2013). The analysis of summative assessment and formative assessment and their roles in college English assessment system. Journal of Language Teaching and Research, 4(2), 335-339. https://doi.org/10.4304/jltr.4.2.335-339
Ratnafuri, W. F. (2011). An analysis of the teacher-made English test in the final test of the 2nd semester of 2010/2011 of the first year students of SMPN 1 Kauman, Tulungagung. State University of Malang.
Rudner, L., & W. Schafer. (2002). What teachers need to know about assessment. Washington, DC: National Education Association.
Salwa, A. (2012). The validity, reliability, level of difficulty and appropriateness of curriculum of the English test. Diponegoro University.
Seo J., & Setiawan, K. (2018). Menteri Muhadjir Effendy: Pendidikan di NTT urutan 2 terbawah. Tempo.Co. https://nasional.tempo.co/read/1048094. Accessed 25 July 2020.
Setiyana, R. (2016). Analysis of summative tests for English. English Education Journal, 7(4), 433-447. http://www.jurnal.unsyiah.ac.id/EEJ/article/view/5525. Accesed 25 July 2020.
Sugianto, A. (2017) Validity and reliability of English summative test for senior high school. Indonesian EFL Journal: Journal of ELT, Linguistics, and Literature, 3(2), 22-38. http://ejournal.kopertais4.or.id/mataraman/index.php/efi/article/view/3191. Accessed 24 July 2020.
Sugianto, A. (2011) Analysis of validity and reliability of English formative tests. Journal of English as a Foreign Language, 1(2), 87-94. https://doi.org/10.23971/jefl.v1i2.193
Widowati, D. H. (2011). Item analysis on a teacher-made try-out test of UAN 2010/2011 of junior high schools in Malang. State University of Malang.
Wulandari A. (2014). An analysis on the content validity of the summative test items at the even semester of the second grade; a case study of MTs Al-Amanah. Syarif Hidayahtullah State Islamic University.
Arikunto, S. (2013). Dasar-dasar evaluasi pendidikan (2nd ed.). Jakarta: Paragonatama Jaya.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Designing and developing useful language tests. Oxford, New York: Oxford University Press.
Brown, H. D. (2004). Language assessment. Principles and classroom practices. White Plains, NY: Pearson Education, Inc.
Chang, C.-C., & Wu, B.-H. (2012). Is teacher assessment reliable or valid for high school students under a web-based portfolio environment? Educational Technology & Society, 15(4), 265–278. https://www.ds.unipi.gr/et&s/journals/15_4/23.pdf. Accesed 24 July 2020.
DiBattista, D., & Kurzawa, L. (2011). Examination of the quality of multiple-choice items on classroom tests. The Canadian Journal for the Scholarship of Teaching and Learning, 2(2). https://doi.org/10.5206/cjsotl-rcacea.2011.2.4
Djiwandono, S. (2011). Tes bahasa. Pengangan bagi pengajar bahasa (2nd ed.). Jakarta: PT. Indeks Jakarta.
Fathoni. (2017). An analysis on content validity of English summative test items of second grade students at MTsN Kalijambe in the academic year 2015/2016. State Islamic Institute of Surakarta.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113-132. https://doi.org/1080/15434303.2011.642041
Furwana, D. (2019). Validity and reliability of teacher-made English summative test at second grade of vocational high school 2 Palopo. Journal of Language and Literature, 13(2), 113-122. https://doi.org/10.15294/lc.v13i2.18967
Griswold, P. A. (1990). Assessing relevance and reliability to improve the quality of teacher-made tests. NASSP Bulletin, 76, 18-24. https://doi.org/10.1177/019263659007452305
Haryudin, A. (2015). Validity and reliability of English summative tests at junior high school in West Bandung. Jurnal Ilmiah P2P STKIP Siliwangi, 2(1), 77-90. https://doi.org/10.22460/p2m.v2i1p77-90.167
Hughes, A. (1989). Testing for language teachers. Cambridge: Cambridge University Press.
Husna, H. H. (2012). An analysis of English summative test for 6th grade students in three public elementary schools in Udanawu District, Blitar Regency. State University of Malang.
Iliya, A. (2014). Formative and summative assessment in educational enterprise. Journal of Education and Practice, 5(20), 111-117. https://www.iiste.org/Journals/index.php/JEP/article/view/14252. Accessed 24 July 2020.
Mindes, G. (2003). Assessing young children (2nd ed.). New Jersey: Pearson Education, Inc.
Munoz, A., Alvarez, M., Casals, S., Gaviria S., & Palacio, M. (2003). Validation of an oral assessment tool for classroom use. Columbian Applied Linguistics Journal, 5(5), 139-157. https://doi.org/10.14483/22487085.186
Nugrahanto, A., Winarsih, D., & Farikah. (2018). The content validity of the summative test items of English for the tenth graders of SMA Negeri 1 Magelang in the school year 2015/2016. Journal of Research on Applied Linguistics Language and Language Teaching, 1(1), 7-14. https://doi.org/10.31002/jrlt.v1i1.188
Nunnally, J. (1978). Psychometric theory. New York: McGrow-Hill Contemporary.
Primadani, A. E. (2013). An analysis of a midterm English test of the 7th grade accelerated class at SMPN 3 Malang. State University of Malang.
Qu, W., & Zhang, C. (2013). The analysis of summative assessment and formative assessment and their roles in college English assessment system. Journal of Language Teaching and Research, 4(2), 335-339. https://doi.org/10.4304/jltr.4.2.335-339
Ratnafuri, W. F. (2011). An analysis of the teacher-made English test in the final test of the 2nd semester of 2010/2011 of the first year students of SMPN 1 Kauman, Tulungagung. State University of Malang.
Rudner, L., & W. Schafer. (2002). What teachers need to know about assessment. Washington, DC: National Education Association.
Salwa, A. (2012). The validity, reliability, level of difficulty and appropriateness of curriculum of the English test. Diponegoro University.
Seo J., & Setiawan, K. (2018). Menteri Muhadjir Effendy: Pendidikan di NTT urutan 2 terbawah. Tempo.Co. https://nasional.tempo.co/read/1048094. Accessed 25 July 2020.
Setiyana, R. (2016). Analysis of summative tests for English. English Education Journal, 7(4), 433-447. http://www.jurnal.unsyiah.ac.id/EEJ/article/view/5525. Accesed 25 July 2020.
Sugianto, A. (2017) Validity and reliability of English summative test for senior high school. Indonesian EFL Journal: Journal of ELT, Linguistics, and Literature, 3(2), 22-38. http://ejournal.kopertais4.or.id/mataraman/index.php/efi/article/view/3191. Accessed 24 July 2020.
Sugianto, A. (2011) Analysis of validity and reliability of English formative tests. Journal of English as a Foreign Language, 1(2), 87-94. https://doi.org/10.23971/jefl.v1i2.193
Widowati, D. H. (2011). Item analysis on a teacher-made try-out test of UAN 2010/2011 of junior high schools in Malang. State University of Malang.
Wulandari A. (2014). An analysis on the content validity of the summative test items at the even semester of the second grade; a case study of MTs Al-Amanah. Syarif Hidayahtullah State Islamic University.
Downloads
Published
2020-09-01
How to Cite
Semiun, T. T., & Luruk, F. D. (2020). The quality of an English summative test of a public junior high school, Kupang-NTT. English Language Teaching Educational Journal, 3(2), 133–141. https://doi.org/10.12928/eltej.v3i2.2311
Issue
Section
Articles
License
Authors who publish in ELTEJ agree to the following terms: Authors retain copyright and grant the ELTEJ right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share (copy and redistribute the material in any medium or format) and adapt (remix, transform, and build upon the material) the work for any purpose, even commercially with an acknowledgement of the work's authorship and initial publication in ELTEJ. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in ELTEJ. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
