Holistic Rubric Validity and Reliability in Essay Assessment Using Rasch Model in Blended Learning Program

DOI

10.2991/978-2-38476-108-1_68How to use a DOI?

Keywords

Essay Assessment; Holistic Rubric; Rasch Model; Validity and Reliability

Abstract

The covid-19 pandemic has forced teachers to adapt with learning method suitable with distance learning, and blended learning program is one of the best options around. Then the necessary assessment of output of this method should be available, valid, and reliable. This study aims to determine the validity and reliability of a holistic scoring rubric developed by Jacob et al. to assess students’ writing in the Blended Learning program by using Rasch model during Covid-19 pandemic. The participants were 55 EFL learners who had taken essay writing course in TOEFL iBT class whereas the writing samples were taken in collaboration with a language center wherein the TOEFL iBT class was held. The research method employed the Rasch model as a quantitative analysis approach by using three Minister software outputs used for data analysis: the “statistical summary output” to obtain figures and data in general, output item one-dimensionality to obtain reliability information, and Fit-Order Items to obtain item validity. The results of the reliability were reflected in Cronbach’s alpha value (a) 0.91, item reliability 0.81, and person reliability 0.89 which show “excellent” reliability performance. The item fit order measured by MNSQ, ZFTD, and PT. Measure correlation with four assessment items: content, structure, diction, and mechanic fulfilled almost all ranges except for writing mechanics showing negative results on the MNSQ. It could be concluded that holistic rubric is the “Valid” measuring tool for assessing students’ abilities in various test settings that require a rubric for students’ essay assessment in blended learning program.

Copyright

© 2024 The Author(s)

Open Access

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

TY  - CONF
AU  - Yenni Arif Rahman
AU  - Nurhayati S.
AU  - Fiza Asri Fauziah Habibah
AU  - Fadilah Fadilah
PY  - 2023
DA  - 2023/09/28
TI  - Holistic Rubric Validity and Reliability in Essay Assessment Using Rasch Model in Blended Learning Program
BT  - Proceedings of the Online Conference of Education Research International (OCERI 2023)
PB  - Atlantis Press
SP  - 685
EP  - 698
SN  - 2352-5398
UR  - https://doi.org/10.2991/978-2-38476-108-1_68
DO  - 10.2991/978-2-38476-108-1_68
ID  - Rahman2023
ER  -