The development of the HOTS test of physics based on modern test theory: Question Modeling through e-learning of moodle LMS

Abstract

This research aims to develop HOTS physics questions based on Modern Test Theory designed and presented with LMS Moodle on e-learning, which can be accessed online. This study also serves as one of the efforts to expand students’ HOTS by applying a variety of HOTS-based learning sources. Further, this research employed the ADDIE model with analysis, design, development, implementation, and evaluation stages. The instrument consisted of 24 multiplechoice physics questions; the questions were designed by following the aspects and sub-aspects of HOTS and validated by the assessment of physics experts, physicists, and lecturers. Moreover, the validity analysis was based on Aiken’s V formula, in which every aspect was confirmed to be valid. The instrument had been tested on 34 students of the Physics Education Department, Universitas Papua. Dichotomy data analysis used the Rasch Model (RM) 1-PL through the Quest program, and the test characteristics comprised item fitness, reliability, and difficulty. The trial result obtained the criteria of INFIT MNSQ mean and standard deviation of 1.0 and 0.0, respectively, indicating that the items fitted the RM1-PL. In addition, the value of item reliability based on the item estimate summary arrived at 0.66; meanwhile, the case reliability under the summary of the case estimate accounted for 0.85.