DEVELOPMENT OF TEST INSTRUMENTS TO MEASURE COMPUTATIONAL THINKING COMPETENCE USING FORMATIVE EVALUATION DESIGN FLOW Putri Andriani Hartanto, Eki Nugraha, Rizki Hikmawan, Ahmad Fauzi
Universitas Pendidikan Indonesia
Abstract
Education needs to integrate Information and Communication Technologies (ICT) with computational thinking skills. Through an independent curriculum, computational thinking is included in the curriculum, one of which is at the junior high school (SMP) level. To find out computational thinking competencies, evaluation is needed to measure these competencies. However, there are still limited ways to measure and evaluate computational thinking skills and there is still a lack of appropriate combinations of tasks to assess computational thinking dimensions, so a test instrument is needed that can measure computational thinking competence. This study aims to design a test instrument, determine the validity and reliability of the computational thinking test instrument that has been designed. The method used in this study is the Research and Development (R&D) method with a quantitative research approach. The research design flow uses formative evaluation. The population in this study consists of students from SMP Negeri 1 Soreang. The sample includes ICT and Science subject teachers, as well as seventh-grade students of SMP Negeri 1 Soreang in the 2022/2023 academic year, who implement the Merdeka Curriculum in their learning process. The findings from this study are that the stages of developing test instruments consist of test instrument design, validity testing, and inter-rater reliability tests. At the design stage, an analysis of science learning objectives and computational thinking indicators was carried out, making test instrument grids, making scoring guidelines and designing computational thinking test instruments. Then a validity test was carried out by CT experts and science experts and it was found that all test instruments were valid with an average value of 3.727. Furthermore, the inter-rater reliability test was carried out. The inter-rater reliability test was carried out with the Cronbach^s alpha coefficient for multiple choice questions and it was found that questions number 2 and 4 were reliable, while numbers 1 and 3 were not reliable. As for the description questions, a test was carried out with the Cohen^s kappa coefficient and the Kappa value was obtained with sufficient, strong, and very strong interpretations
Keywords: -Development of Test Instruments, Evaluation of Test Instruments, Computational Thinking Competence, Research and Development (R&D)
Topic: Computer Science and Computer Science Education
