Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023)

<Previous Article In Volume
Next Article In Volume>

Selecting the Top Artisan Woodcraft Projects Using Many Facet Rasch Measurement (MFRM) Model

Authors
Mohd Zali Mohd Nor1, *, Bambang Sumintono2, Mohd Shaharul Nizam3, Zulkifle Sani3
1MyRasch Malaysia, Shah Alam, Malaysia
2Universitas Islam Internasional Indonesia, Jakarta, Indonesia
3GSKK Malaysia, Shah Alam, Malaysia
*Corresponding author. Email: zali_nor@yahoo.com
Corresponding Author
Mohd Zali Mohd Nor
Available Online 22 August 2024.
DOI
10.2991/978-94-6463-494-5_15How to use a DOI?
Keywords
Woodworking Project Assessment; MFRM; Rasch Measurement Model
Abstract

Once a year, the Geng Seni Kayu Kreatif (GSKK – Creative Woodworkers Group) society conducts a competition for budding craft persons to showcase their ideas and skills. The main objectives were two-fold. First is to check if the selected rubrics are suitable. Second was to rank the woodcraft entries, as fairly as possible. 12 items were identified to measure the woodcraft quality aspects. 20 craft entries were randomly rated by three judges. Rasch MFRM model was used to analyze and rank the items and entries. Item mean is 0.46 and reliability is 0.88. Rater reliability 0.98 indicates raters could reliably separate the entries and items. None of the entries were found misfitting. The scale structure did not exhibit disordered Rasch-Andrich thresholds and had good progressive average measures. Only three entries (E13, E16 and E20) were identified with significant bias among raters, due to significant stricter marks given by one of the raters. Overall, this framework rubric is considered useful for judging woodcraft competitions. It provides non, or very little bias on judgement, and allow less time to judge a competition. However higher-order items need to be improved for future competition, to segregate top entries.

Copyright
© 2024 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023)
Series
Atlantis Highlights in Social Sciences, Education and Humanities
Publication Date
22 August 2024
ISBN
978-94-6463-494-5
ISSN
2667-128X
DOI
10.2991/978-94-6463-494-5_15How to use a DOI?
Copyright
© 2024 The Author(s)
Open Access
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

Cite this article

risenwbib
TY  - CONF
AU  - Mohd Zali Mohd Nor
AU  - Bambang Sumintono
AU  - Mohd Shaharul Nizam
AU  - Zulkifle Sani
PY  - 2024
DA  - 2024/08/22
TI  - Selecting the Top Artisan Woodcraft Projects Using Many Facet Rasch Measurement (MFRM) Model
BT  - Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023)
PB  - Atlantis Press
SP  - 242
EP  - 250
SN  - 2667-128X
UR  - https://doi.org/10.2991/978-94-6463-494-5_15
DO  - 10.2991/978-94-6463-494-5_15
ID  - Nor2024
ER  -