Perception Scale of Online Learning in the Indonesian Context During the Covid-19 Pandemic: Psychometric Properties Based on the Rasch Model
DOI:
https://doi.org/10.12928/irip.v5i2.6544Keywords:
Psychometric properties, Students’ perception, Online Learning, Rasch modelAbstract
This study aims to evaluate the psychometric properties of students' perception scales about online learning during the Covid-19 pandemic in Indonesian culture. This study involved 176 students (Male = 54% and Female = 46%) at the junior and senior high school levels from public schools in Yogyakarta, Indonesia. The age of the respondents ranged from 11 to 17 years, with a mean of 13.5 years and a standard deviation of 1.4 years. The online learning perception scale adopts 16 items developed by Bhagat and colleagues. The psychometric properties of the scale were evaluated based on the reliability of the person and item, the suitability of the Rasch model, the functionality of using a 5-point rating scale, and its unidimensionality. The analysis results show that the scale has good consistency and performance in the Indonesian context. Sixteen items are a good fit for the model and are unidimensional. The 4-point Likert rating scale is more effective than the original 5-point rating scale. So, 16 items in POSTOL have adequate psychometric properties to be used on students in Indonesia.
References
A. E. Clark, H. Nong, H. Zhu, and R. Zhu, “Compensating for Academic Loss: Online Learning and Student Performance During the COVID-19 Pandemic,” China Econ. Rev., vol. 68, no. May, p. 101629, 2021, https://doi.org/10.1016/j.chieco.2021.101629.
M. B. Ulla and W. F. Perales, “Facebook as an Integrated Online Learning Support Application During the COVID19 Pandemic: Thai university students’ Experiences and Perspectives,” Heliyon, vol. 7, no. 11, p. e08317, Nov. 2021, https://doi.org/10.1016/j.heliyon.2021.e08317.
N. Zafar and J. Ahamed, “Emerging Technologies for the Management of COVID19: A Review,” Sustain. Oper. Comput., vol. 3, no. May, pp. 249–257, 2022, https://doi.org/10.1016/j.susoc.2022.05.002.
R. Chaker, F. Bouchet, and R. Bachelet, “How Do Online Learning Intentions Lead to Learning Outcomes? The Mediating Effect of the Autotelic Dimension of Flow in a MOOC,” Comput. Human Behav., vol. 134, p. 107306, Sep. 2022, https://doi.org/10.1016/j.chb.2022.107306.
A. Hurajova, D. Kollarova, and L. Huraj, “Trends in Education During the Pandemic: Modern Online Technologies as a Tool for the Sustainability of University Education in the Field of Media and Communication Studies,” Heliyon, vol. 8, no. 5, p. e09367, May 2022, https://doi.org/10.1016/j.heliyon.2022.e09367.
M. Maqableh and M. Alia, “Evaluation Online Learning of Undergraduate Students Under Lockdown Amidst COVID-19 Pandemic: The Online Learning Experience and Students’ Satisfaction,” Child. Youth Serv. Rev., vol. 128, no. July, p. 106160, 2021, https://doi.org/10.1016/j.childyouth.2021.106160.
Y. M. Tang et al., “Comparative Analysis of Student’s Live Online Learning Readiness During the Coronavirus (COVID-19) Pandemic in the Higher Education Sector,” Comput. Educ., vol. 168, no. January, p. 104211, Jul. 2021, https://doi.org/10.1016/j.compedu.2021.104211.
M. Ramdhan, M. I. Sukarelawan, M. A. Thohir, and F. Arifiyanti, “Junior High School Student Perception of Online Learning in Pandemic Covid-19: Gender, Social Media Ownership, and Internet Access Duration Perspective,” Int. J. Educ. Learn., vol. 4, no. 1, pp. 28–40, Apr. 2022, https://doi.org/10.31763/ijele.v4i1.517.
M. Bączek, M. Zagańczyk-Bączek, M. Szpringer, A. Jaroszyński, and B. Wożakowska-Kapłon, “Students’ Perception of Online Learning During the COVID-19 Pandemic: A survey Study of Polish Medical Students,” Medicine (Baltimore)., vol. 100, no. 7, p. e24821, 2021, https://doi.org/10.1097/MD.0000000000024821.
K. L. Smart and J. J. Cappel, “Students’ Perceptions of Online Learning: A Comparative Study,” J. Inf. Technol. Educ. Res., vol. 5, pp. 201–219, 2006, https://doi.org/10.28945/243.
N. Balta, L. Mâță, C. H. Gómez, and K. Tzafilkou, “Students’ Perception And Acceptance of Web-based Technologies: A Multi-Group PLS Analysis in Romania and Spain,” Educ. Inf. Technol., vol. 25, no. 5, pp. 4437–4458, 2020, https://doi.org/10.1007/s10639-020-10170-y.
S. M. Brown, J. R. Doom, S. Lechuga-Peña, S. E. Watamura, and T. Koppels, “Stress and Parenting During the Global COVID-19 Pandemic,” Child Abuse Negl., vol. 110, p. 104699, Dec. 2020, https://doi.org/10.1016/j.chiabu.2020.104699.
A. Nasir et al., “The Outbreak of COVID-19: Resilience and Its Predictors Among Parents of Schoolchildren Carrying Out Online Learning in Indonesia,” Clin. Epidemiol. Glob. Heal., vol. 12, p. 100890, Oct. 2021, https://doi.org/10.1016/j.cegh.2021.100890.
D. P. Parlindungan, M. Al Ghani, and S. Nurhaliza, “Peranan Guru dan Orang Tua dalam Menghadapi Pembelajaran Jarak Jauh (PJJ) Dimasa Pandemi Covid-19 di SDS Islam An-Nuriyah [The Role of Teachers and Parents in Facing Distance Learning (DL) During the Covid-19 Pandemic at SDS Islam An-Nuriyah],” in Penguatan Kapasitas dan Kolaborasi Penelitian Serta Pengabdian kepada Masyarakat Pasca Pandemi Covid-19, Apr. 2020, pp. 1–10, [Online]. Available: https://jurnal.umj.ac.id/index.php/semnaslit/article/view/8795.
W. R. Syachtiyani and N. Trisnawati, “Analisis Motivasi Belajar dan Hasil Belajar Siswa di Masa Pandemi Covid-19 [Analysis of Learning Motivation and Student Learning Outcomes during the Covid-19 Pandemic],” Prima Magistra J. Ilm. Kependidikan, vol. 2, no. 1, pp. 90–101, Mar. 2021, https://doi.org/10.37478/jpm.v2i1.878.
R. Frei-Landau and O. Avidov-Ungar, “Educational Equity Amidst COVID-19: Exploring the Online Learning Challenges of Bedouin and Jewish Female Preservice Teachers in Israel,” Teach. Teach. Educ., vol. 111, p. 103623, Mar. 2022, https://doi.org/10.1016/j.tate.2021.103623.
A. J. van Deursen and J. A. van Dijk, “The First-level Digital Divide Shifts from Inequalities in Physical Access to Inequalities in Material Access,” New Media Soc., vol. 21, no. 2, pp. 354–375, Feb. 2019, https://doi.org/10.1177/1461444818797082.
Z. Larisu, M. Idrus, A. Upe, and S. S. Kasim, “Pengembangan Perangkat Pembelajaran Jarak Jauh (PJJ) Berbasis Website Sebagai Media Komunikasi Interaktif di Masa Pandemi Covid-19 di Kota Kendari [Development of Website-Based Distance Learning (DL) Devices as Interactive Communication Media during the Covid-19 Pandemic in Kendari City],” Anoa J. Pengabdi. Masy. Sos. Polit. Budaya, Hukum, Ekon., vol. 2, no. 1, pp. 127–136, Oct. 2020, https://doi.org/10.52423/anoa.v2i1.15160.
N. R. Chandrasiri and B. S. Weerakoon, “Online Learning during the COVID-19 Pandemic: Perceptions of Aallied Health Sciences Undergraduates,” Radiography, vol. 28, no. 2, pp. 545–549, May 2022, https://doi.org/10.1016/j.radi.2021.11.008.
U. K. Menon et al., “Perceptions of Undergraduate Medical Students Regarding Institutional Online Teaching-Learning Programme,” Med. J. Armed Forces India, vol. 77, pp. S227–S233, Feb. 2021, https://doi.org/10.1016/j.mjafi.2021.01.006.
S. Muflih, S. Abuhammad, S. Al-Azzam, K. H. Alzoubi, M. Muflih, and R. Karasneh, “Online Learning for Undergraduate Health Professional Education During COVID-19: Jordanian Medical Students’ Attitudes and Perceptions,” Heliyon, vol. 7, no. 9, p. e08031, Sep. 2021, https://doi.org/10.1016/j.heliyon.2021.e08031.
C.-J. R. Siah, C.-M. Huang, Y. S. R. Poon, and S.-L. S. Koh, “Nursing Students’ Perceptions of Online Learning and Its Impact on Knowledge Level,” Nurse Educ. Today, vol. 112, p. 105327, May 2022, https://doi.org/10.1016/j.nedt.2022.105327.
A. H. Y. Yau, M. W. L. Yeung, and C. Y. P. Lee, “A Co-Orientation Analysis of Teachers’ and Students’ Perceptions of Online Teaching and Learning in Hong Kong Higher Education During the COVID-19 Pandemic,” Stud. Educ. Eval., vol. 72, p. 101128, Mar. 2022, https://doi.org/10.1016/j.stueduc.2022.101128.
K. K. Bhagat, L. Y. Wu, and C. Chang, “Development and Validation of the Perception of Students Towards Online Learning (POSTOL),” Educ. Technol. Soc., vol. 19, no. 1, pp. 350–359, 2016, https://doi.org/10.1037/t64255-000.
R. Gómez-Chacón, J. García-Fernández, V. Morales-Sánchez, and A. Hernández-Mendo, “Adaptation and Validation of the Healthy Employee Questionnaire of the HERO Model.,” An. Psicol., vol. 36, no. 2, pp. 361–369, 2020, https://doi.org/10.6018/analesps.395431.
E. Monaco et al., “Translation, Cross-cultural Adaptation, and Validation of the Italian Version of the Anterior Cruciate Ligament–Return to Sport After Injury (ACL-RSI) Scale and Its Integration into the K-STARTS Test,” J. Orthop. Traumatol., vol. 23, no. 1, 2022, https://doi.org/10.1186/s10195-021-00622-7.
K. Saghafi, S. M. R. Amirian, and M. E. Shirvan, “Differential Item Functioning Analysis of Persian Adaptation of Foreign Language Classroom Anxiety Scale Against Gender,” Hum. Arenas, no. 0123456789, Jan. 2021, https://doi.org/10.1007/s42087-020-00172-0.
M. I. Sukarelawan, J. Jumadi, H. Kuswanto, S. Soeharto, and F. N. Hikmah, “Rasch Analysis to Evaluate the Psychometric Properties of Junior Metacognitive Awareness Inventory in the Indonesian Context,” J. Pendidik. IPA Indones., vol. 10, no. 4, pp. 486–495, Dec. 2021, https://doi.org/10.15294/jpii.v10i4.27114.
D. E. Beaton, C. Bombardier, F. Guillemin, and M. B. Ferraz, “Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures,” Spine (Phila. Pa. 1976)., vol. 25, no. 24, pp. 3186–3191, 2000, https://doi.org/10.1097/00007632-200012150-00014.
W. J. Boone, “Rasch Analysis for Instrument Development: Why, When, and How?,” CBE—Life Sci. Educ., vol. 15, no. 4, p. rm4, Dec. 2016, https://doi.org/10.1187/cbe.16-04-0148.
N. M. Papini et al., “Psychometric Properties of the 26-Item Eating Attitudes Test (EAT-26): An Application of Rasch Analysis,” J. Eat. Disord., vol. 10, no. 1, p. 62, Dec. 2022, https://doi.org/10.1186/s40337-022-00580-3.
D. C. Briggs, “Interpreting and Visualizing the Unit of Measurement in the Rasch Model,” Measurement, vol. 146, pp. 961–971, Nov. 2019, https://doi.org/10.1016/j.measurement.2019.07.035.
B. Sumintono and W. Widhiarso, Aplikasi Model Rasch untuk Penelitian Ilmu-Ilmu Sosial [Rasch Model Application for Social Sciences Research]. Cimahi: Trim Komunikata Publishing House, 2014.
H. C. . De Vet, C. B. Terwee, L. B. Mokkink, and D. L. Knol, Measurement in Medicine: A Practical Guide. New York: Cambridge University Press, 2011.
P. Asunta, H. Viholainen, T. Ahonen, and P. Rintala, “Psychometric Properties of Observational Tools for Identifying Motor Difficulties – A Systematic Review,” BMC Pediatr., vol. 19, no. 1, p. 322, Dec. 2019, https://doi.org/10.1186/s12887-019-1657-6.
L. G. Portney and M. P. Watkins, Foundations of clinical research: applications to practice. New Jersy: Pearson Education, 2009.
A. Supratiknya, Pengukuran Psikologis [Psychological Measurement] Yogyakarta: Penerbit USD, 2014.
E.-H. Lee, Y. W. Lee, and H.-J. Kang, “Psychometric properties of the Revised Diabetes Knowledge Test using Rasch analysis,” Patient Educ. Couns., vol. 105, no. 4, pp. 851–857, Apr. 2022, https://doi.org/10.1016/j.pec.2021.07.013.
F.-W. Hu, C.-H. Lin, F.-R. Yueh, Y.-T. Lo, and C.-Y. Lin, “Development and Psychometric Evaluation of the Physical Resilience Instrument for Older Adults (PRIFOR),” BMC Geriatr., vol. 22, no. 1, p. 229, Dec. 2022, https://doi.org/10.1186/s12877-022-02918-7.
G. Wiwaha, D. M. Sari, V. Biben, D. K. Sunjaya, and D. Hilmanto, “Translation and Validation of Indonesian Version of Pediatric Quality of Life InventoryTM (PedsQLTM) Neuromuscular Module,” Health Qual. Life Outcomes, vol. 20, no. 1, p. 33, Dec. 2022, https://doi.org/10.1186/s12955-022-01933-x.
F. Liu, Z. Zhang, B. Lin, Z. Ping, and Y. Mei, “Assessing the Psychometric Properties of the Chinese Return-to-work Self-efficacy Questionnaire using Rasch Model analysis,” Health Qual. Life Outcomes, vol. 20, no. 1, p. 27, Dec. 2022, https://doi.org/10.1186/s12955-022-01929-7.
C. Jong, T. E. Hodges, K. D. Royal, and R. Welder, “Instruments to Measure Elementary Preservice Teachers’ Conceptions: An Application of the Rasch Rating Scale Model,” Educ. Res. Q., vol. 39, no. 1, pp. 21–48, 2015.
W. Ling Lee, K. Chinna, and B. Sumintono, “Psychometrics Assessment of HeartQoL Questionnaire: A Rasch Analysis,” Eur. J. Prev. Cardiol., p. 2047487320902322, Feb. 2020, https://doi.org/10.1177/2047487320902322.
M. Khalil, S. Almestkawy, T. E. I. Omar, M. A. Ferro, and K. N. Speechley, “Psychometric Properties of an Arabic Translation of the Quality of Life in Childhood epilepsy questionnaire (QOLCE-55),” Epilepsy Behav., vol. 129, p. 108637, Apr. 2022, https://doi.org/10.1016/j.yebeh.2022.108637.
A. Arslanoğlu and O. Durgut, “Linguistic Adaptation, Reliability, and Validation of the Turkish Version of the Reflux Symptom Index,” J. Voice, vol. 36, no. 1, pp. 146.e1-146.e4, 2022, https://doi.org/10.1016/j.jvoice.2020.04.022.
B. Setiawan, M. Panduwangi, and B. Sumintono, “A Rasch Analysis of the Community’s Preference for Different Attributes of Islamic Banks in Indonesia,” Int. J. Soc. Econ., vol. 45, no. 12, pp. 1647–1662, Dec. 2018, https://doi.org/10.1108/IJSE-07-2017-0294.
I. Llamas-Ramos, R. Llamas-Ramos, J. Buz, M. Cortés-Rodríguez, and A. M. Martín-Nogueras, “Construct Validity of the Spanish Versions of the Memorial Symptom Assessment Scale Short Form and Condensed Form: Rasch Analysis of Responses in Oncology Outpatients,” J. Pain Symptom Manage., vol. 55, no. 6, pp. 1480–1491, 2018, https://doi.org/10.1016/j.jpainsymman.2018.02.017.
R. M. A. Alali, “Assessment for Learning at Saudi Universities: An Analytical Study of Actual Practices,” J. Institutional Res. South East Asia, vol. 19, no. 1, pp. 20–41, 2021, [Online]. Available: http://www.seaairweb.info/journal/articles/JIRSEA_v19_n01/JIRSEA_v19_n01_Article02.pdf.
B. Sumintono and W. Widhiarso, Aplikasi Pemodelan Rasch pada Asesmen Pendidikan [Rasch Modeling Applications in Educational Assessment]. Cimahi: Trim Komunikata, 2015.
J. M. Linacre, “Winsteps® (Version 4.6.1) [Computer Software].” 2021, [Online]. Available: http://www.winsteps.com.
M. N. Norhayati, A. Fatin Imtithal, and M. J. Nor Akma, “Psychometric Properties of the Malay Version of the Women’s Views of Birth Labour Satisfaction Questionnaire using the Rasch Measurement Model: A Cross Sectional Study,” BMC Pregnancy Childbirth, vol. 20, no. 1, pp. 1–8, 2020, https://doi.org/10.1186/s12884-020-02975-z.
J. M. Linacre, A User’s Guide and Program Manual to Winstep: Rasch Model Computer Program. Chicago: MESA Press, 2005.
S. N. T. M. Yasin, M. F. M. Yunus, and I. Ismail, “The Use of Rasch Measurement Model for the Validity and Reliability,” J. Couns. Educ. Technol., vol. 1, no. 2, p. 22, 2018, https://doi.org/10.32698/0111.
W. Akram, M. S. E. Hussein, S. Ahmad, M. N. Mamat, and N. E. Ismail, “Validation of the Knowledge, Attitude and Perceived Practice of Asthma Instrument Among Community Pharmacists Using Rasch Analysis,” Saudi Pharm. J., vol. 23, no. 5, pp. 499–503, 2015, https://doi.org/10.1016/j.jsps.2015.01.011.
M. J. Allen and W. M. Yen, Introduction to Measurement Theory. Waveland Press, 2001.
M. Tabatabaee-Yazdi, K. Motallebzadeh, H. Ashraf, and P. Baghaei, “Development and Validation of a Teacher Success Questionnaire Using the Rasch Model,” Int. J. Instr., vol. 11, no. 2, pp. 129–144, Apr. 2018, https://doi.org/10.12973/iji.2018.11210a.
T. Bond and C. M. Fox, Applying the Rasch Model: Fundamental Measurement in the Human Sciences, 3rd ed. New York: Routledge, 2015.
H. S. You, K. Haudek, J. Merrill, and M. Urban-Lurain, “Construct Validity of Computer Scored Constructed Response Items in Undergraduate Introductory Biology Courses,” in Rasch Measurement, Singapore: Springer Singapore, 2020, pp. 223–240.
Downloads
Published
Issue
Section
License
Copyright (c) 2022 Eko Nursulistyo, Toni Kus Indratno, Ety Dwiastuti, Fitria Arifiyanti, Ariati Dina Puspitasari, Nurul Syafiqah Yap binti Abdullah, Moh. Irma Sukarelawan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish in IRiP agree to the following terms: Authors retain copyright and grant the IRiP right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share (copy and redistribute the material in any medium or format) and adapt (remix, transform, and build upon the material) the work for any purpose, even commercially with an acknowledgment of the work's authorship and initial publication in IRiP. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in IRiP. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
